-- Logs begin at Mon 2022-05-23 10:02:57 UTC, end at Mon 2022-05-23 11:12:13 UTC. -- May 23 10:42:29.106258 dv-cinder-836996-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 10:42:29.116702 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 10:42:29.118555 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 10:42:29 2022] *** May 23 10:42:29.118555 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 10:42:29.118555 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 10:42:29.118555 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: nodename: dv-cinder-836996-25-iscsi May 23 10:42:29.118555 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: machine: x86_64 May 23 10:42:29.118555 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: clock source: unix May 23 10:42:29.118555 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: pcre jit disabled May 23 10:42:29.118555 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: detected number of CPU cores: 4 May 23 10:42:29.118555 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: current working directory: / May 23 10:42:29.118555 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: detected binary path: /usr/bin/uwsgi-core May 23 10:42:29.119264 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: your processes number limit is 47680 May 23 10:42:29.119264 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: your memory page size is 4096 bytes May 23 10:42:29.119264 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: detected max file descriptor number: 2048 May 23 10:42:29.119264 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: lock engine: pthread robust mutexes May 23 10:42:29.119264 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: thunder lock: enabled May 23 10:42:29.119264 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 10:42:29.119264 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 10:42:29.164035 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: Python main interpreter initialized at 0x55b2d5d759c0 May 23 10:42:29.164035 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: python threads support enabled May 23 10:42:29.164035 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: your server socket listen backlog is limited to 100 connections May 23 10:42:29.164035 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: your mercy for graceful operations on workers is 90 seconds May 23 10:42:29.164338 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: mapped 403077 bytes (393 KB) for 2 cores May 23 10:42:29.164450 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: *** Operational MODE: preforking *** May 23 10:42:29.164710 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: *** uWSGI is running in multiple interpreter mode *** May 23 10:42:29.164710 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: spawned uWSGI master process (pid: 114597) May 23 10:42:29.164888 dv-cinder-836996-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 10:42:29.165970 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: spawned uWSGI worker 1 (pid: 114598, cores: 1) May 23 10:42:29.165970 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: spawned uWSGI worker 2 (pid: 114599, cores: 1) May 23 10:42:29.165970 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 10:42:30.333151 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 10:42:30.333767 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 10:42:31.053962 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 10:42:31.053962 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: from cryptography.utils import int_from_bytes May 23 10:42:31.054316 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 10:42:31.054316 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: from cryptography.utils import int_from_bytes May 23 10:42:31.054867 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 10:42:31.054867 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: from cryptography.utils import int_from_bytes May 23 10:42:31.055197 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 10:42:31.055197 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: from cryptography.utils import int_from_bytes May 23 10:42:33.645537 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 10:42:33.646246 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 10:42:33.646346 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 10:42:33.646346 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 10:42:33.646758 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 10:42:33.646758 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 10:42:33.646897 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 10:42:33.646968 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 10:42:33.647188 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 10:42:33.647379 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.647470 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 10:42:33.647617 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.647808 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.647938 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.648132 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.648259 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.648454 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.648589 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.648779 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.648939 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.649105 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.649205 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.649415 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.649510 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.649731 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.649833 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.650076 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.650178 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.650402 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.650493 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.650664 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.650774 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-25-iscsi {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.650973 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.651067 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.651301 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-25-iscsi {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.651394 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.651620 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.651716 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.651923 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.652014 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.652225 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.652309 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.652539 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.652624 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.652839 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.653484 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.653709 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.653862 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.654040 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.654349 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.654548 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.654657 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.654857 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.654961 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.655161 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.655285 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.655457 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.655616 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.655789 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.655949 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.656121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.656317 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.656510 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.656708 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.656900 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.657084 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.657238 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.657449 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.657607 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.657819 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-25-iscsi {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.658014 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.658206 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.658403 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-25-iscsi {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.658586 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.658763 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.658974 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.659161 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.659350 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.659555 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.659757 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.659913 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.660073 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.660242 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.660401 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.660525 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.660645 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.660809 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.660944 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.661078 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.661206 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.661333 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.661492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.661631 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.661762 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.661889 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.662037 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.662160 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.662280 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.662399 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.662536 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.662664 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.662817 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.662947 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.663074 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.663194 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.663323 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.663450 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.663576 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.663703 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.663830 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.663967 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.664088 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.664214 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.664341 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.664467 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.664594 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.664727 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.664848 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.664979 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.665100 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.665227 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.665361 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.665544 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.665669 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.665796 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.665925 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.666076 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.666214 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.666341 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.666473 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.666593 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.666737 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.666875 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.667045 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.667180 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.667350 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.667476 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.667656 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.667793 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.667960 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.668094 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.668265 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.668397 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.668600 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.668778 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.669462 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.669588 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.669784 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.669910 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.670115 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.670253 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.670436 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.670572 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.670804 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.670935 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.671072 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.671194 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.671361 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.671486 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.671699 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.671824 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.672015 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.672141 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.672321 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.672454 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.672637 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.672763 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.672948 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.673072 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.673252 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.673377 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.673555 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.673687 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.673893 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.674063 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.674199 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.674322 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.674474 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.674613 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.674788 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.674918 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.675040 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.675170 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.675320 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.675457 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.675618 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.675750 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.675922 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.676054 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.676225 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.676358 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.676527 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.676656 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.676831 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.676963 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.677129 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.677261 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.677424 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.677555 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.677726 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.677862 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.678054 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.678191 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.678357 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.678482 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.678658 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.678781 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.678962 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.679097 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.679262 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.679386 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.679565 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.679692 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.679867 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.679992 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.680166 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.680297 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.680480 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.680605 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.680782 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.680906 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.681086 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.681210 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.681387 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.681511 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.681688 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.681829 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.682012 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.682151 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.682317 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.682443 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.682621 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.682746 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.682922 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.683047 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.683229 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.683358 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.683531 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.683663 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.683834 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.683960 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.684143 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.684302 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.684469 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.684601 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.684773 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.684901 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.685070 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.685193 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.685373 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.685497 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.685677 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.685811 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.686001 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.686173 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.686308 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.686530 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.686655 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.686837 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.686964 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.687137 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.687272 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.687438 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.687563 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.687738 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.687875 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.688039 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.688170 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.688338 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.688468 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.688638 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.688770 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.688935 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.689062 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.689250 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.689380 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.689554 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.689687 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.689860 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.690046 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.690178 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.690307 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.690481 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.690616 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.690799 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:42:33.690925 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.691138 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.691263 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.691467 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.691609 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.691797 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.691933 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.692107 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.692231 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.692437 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.692572 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.692749 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.692874 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.693064 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.693188 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.693372 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.693497 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.693686 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.693817 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.694029 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.694165 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.694339 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.694472 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.694648 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.694773 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.694958 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.695089 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.695275 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.695426 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.695588 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.695720 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.695903 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.696041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.696215 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.696339 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.696523 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.696647 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.696838 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.696967 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.697147 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.697272 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.697460 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.697599 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.697768 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.697904 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.698116 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.698248 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.698425 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.698550 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.698765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.698892 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.699087 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.699211 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.699405 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.699532 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.699718 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.699889 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.700055 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.700180 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.700364 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.700487 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.700674 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.700811 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.700988 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.701118 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.701305 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.701434 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.701623 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.701761 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.701932 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.702101 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.702268 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.702391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.702577 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.702703 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.702888 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.703019 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.703194 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.703317 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.703504 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.703629 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.703813 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.703938 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.704139 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.704262 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.704450 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.704578 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.704762 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.704887 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.705069 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.705193 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.705381 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.705504 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.705688 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.705813 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.706014 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.706157 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.706324 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.706448 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.706627 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.706751 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.706932 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.707070 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.707233 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.707357 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.707539 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.707663 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.707841 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.707976 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.708174 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.708305 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.708468 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.708591 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.708774 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.708906 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.709087 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.709212 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.709390 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.709521 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.709697 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.709824 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.710026 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.710152 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.710336 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.710460 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.710640 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.710772 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.710944 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.711069 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.711251 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.711373 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.711553 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.711684 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.711856 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.711979 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.712168 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.712291 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.712473 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.712596 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.712779 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.712903 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.713081 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.713219 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.713384 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.713516 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.713696 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.713827 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.714026 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.714163 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.714337 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.714467 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.714646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.714778 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.714955 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.715088 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.715265 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.715395 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.716093 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.716220 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.716405 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.716540 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.716731 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.716855 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.717058 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.717183 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.717360 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.717498 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.717683 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.717809 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.718013 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.718142 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.718328 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.718456 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.718629 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.718760 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.718934 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.719067 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.719234 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.719366 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.719538 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.719671 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.719840 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.719974 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.720143 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.720276 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.720445 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.720571 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.720750 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.720887 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.721080 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.721210 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.721333 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.721453 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.721634 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.721769 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.721972 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.722112 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.722283 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.722414 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.722584 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.722717 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.722888 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.723014 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.723191 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.723316 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.723533 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.723736 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.723860 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.723988 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.724165 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.724298 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.724491 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.724616 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.724805 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.724937 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.725123 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.725255 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.725434 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.725558 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.725745 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.725870 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.726080 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.726204 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.726389 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.726521 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.726700 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.726826 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.727009 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.727132 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.727325 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.727450 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.727634 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.727759 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.727952 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.728078 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.728261 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.728399 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.728580 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.728705 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.728885 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.729019 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.729200 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.729323 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.729503 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.729628 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.729819 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.730003 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.730182 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.730318 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.730505 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.730630 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.730819 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.730952 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.731187 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.731793 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.731989 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.732114 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.732302 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.732437 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.732609 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.732739 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.732918 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.733043 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.733227 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.733354 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.733537 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.733669 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.733851 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.734010 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.734184 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.734311 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.734501 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.734625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.734809 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.734932 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.735126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.735252 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.735429 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.735553 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.735743 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.735868 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.736043 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.736168 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.736354 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.736480 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.736680 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.736805 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.736991 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.737115 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.737305 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.737431 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.737615 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.737748 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.737923 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.738103 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.738257 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.738393 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.738562 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.738698 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.738868 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.738993 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.739168 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.739291 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.739472 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.739607 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.739778 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.739911 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.740086 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.740203 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.740390 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.740525 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.740700 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.740833 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.741003 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.741128 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.741305 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.741438 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.741609 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.741740 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.741910 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.742058 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.742236 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.742363 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.742545 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.742671 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.742864 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.742990 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.743173 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.743300 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.743483 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.743608 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.743790 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.743915 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.744088 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.744218 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.744388 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.744514 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.744695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.744831 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.745057 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.745189 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.745311 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.745431 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.745580 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.745716 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.745879 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.746044 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.746238 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.746389 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.746543 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.746700 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.746870 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.747004 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.747183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.747313 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.747498 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.747632 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.747804 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.747928 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.748112 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.748235 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.748417 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.748550 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.748724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.748850 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.749032 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.749155 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.749339 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.749463 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.749644 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.749770 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.749968 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.750100 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.750279 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.750405 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.750590 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.750723 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.750898 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.751022 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.751210 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.751369 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.751513 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.751637 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.751819 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.751953 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.752124 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.752249 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.752425 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.752550 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.752732 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.753001 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.753131 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.753334 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.753592 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.753718 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.753921 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.754098 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.754263 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.754395 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.754582 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.754712 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.754899 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.755036 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.755216 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.755341 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.755545 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.755669 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.755852 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.755986 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.756166 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.756292 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.756473 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.756608 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.756779 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.756912 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.757083 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.757217 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.757386 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.757516 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.757692 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.757822 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.758015 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.758153 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.758317 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.758449 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.758622 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.758745 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.758927 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.759051 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.759230 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.759356 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.759531 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.759657 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.759833 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.759960 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.760135 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.760260 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.760445 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.760568 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.760745 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.760877 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.761052 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.761177 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.761355 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.761491 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.761659 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.761783 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.761996 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.762128 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.762289 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.762469 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.762615 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.762739 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.762918 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.763054 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.763259 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.763392 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.763564 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.763689 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.763900 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.764031 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.764224 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.764358 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.764536 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.764659 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.764851 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.764983 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.765155 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.765537 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.765718 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.765843 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.766052 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.766175 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.766338 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.766465 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.766641 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.766767 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.766943 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.767067 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.767248 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.767374 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.767549 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.767684 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.767858 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.767984 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.768164 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.768290 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.768466 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.768590 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.768770 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.768893 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.769069 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.769204 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.769391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.769527 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.769674 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.769808 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.769998 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.770126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.770308 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.770433 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.770609 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.770745 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.770913 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.771038 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.771217 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.771348 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.771524 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.771656 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.771829 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.771960 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.772135 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.772266 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.772438 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.772576 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.772743 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.772867 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.773046 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.773177 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.773348 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.773481 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.773651 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.773776 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.773972 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.774098 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.774287 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.774413 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.774591 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.774716 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.774897 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.775029 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.775202 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.775328 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.775505 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.775643 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.775805 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.775931 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.776107 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.776232 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.776406 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.776531 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.776709 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.776912 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.777044 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.777175 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.777320 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.777453 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.777628 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.777760 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.778451 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.778597 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.778764 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.778889 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.779068 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.779208 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.779370 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.779503 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.779670 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.779793 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.779973 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.780113 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.780275 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.780399 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.780572 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.780695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.780873 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.781000 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.781171 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.781298 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.781473 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.781597 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.781778 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.781902 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.782108 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.782243 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.782410 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.782536 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.782712 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.782839 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.783012 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.783138 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.783353 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.783488 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.783659 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.783788 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.783992 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.784115 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.784306 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.784439 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.784615 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.784739 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.784926 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.785050 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.785235 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.785373 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.785536 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.785659 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.785843 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.785993 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.786171 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.786309 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.786483 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.786617 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.786787 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.786911 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.787089 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.787222 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.787388 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.787512 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.787688 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.787812 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.788002 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.788135 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.788307 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.788431 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.788615 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.788741 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.788931 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.789057 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.789233 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.789356 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.789542 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.789667 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.789842 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.790018 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.790173 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.790297 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.790478 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.790601 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.790783 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.790909 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.791086 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.791209 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.791390 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.791522 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.791698 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.791832 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.792008 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.792131 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.792312 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.792445 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.792616 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.792747 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.792919 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.793042 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.793218 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.793351 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.793523 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.793690 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.794397 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.794536 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.794705 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.794839 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.795008 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.795131 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.795317 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.795442 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.795617 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.795754 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.795922 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.796048 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.796224 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.796350 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.796530 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.796664 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.796832 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.796957 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.797242 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.797366 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.797548 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.797682 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.797853 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.798029 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.798181 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.798307 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.798489 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.798615 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.798799 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.798924 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.799101 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.799226 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.799410 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.799541 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.799711 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.799843 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.800112 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.800246 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.800424 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.800549 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.800729 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.800854 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.801033 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.801171 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.801335 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.801472 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.801636 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.801761 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.801941 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.802105 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.802266 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.802391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.802571 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.802703 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.802869 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.803002 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.803172 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.803297 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.803492 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.803617 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.803792 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.803918 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.804108 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.804234 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.804494 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.804617 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.804816 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.804948 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.805119 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.805252 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.805508 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.805633 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.805826 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.805980 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.806159 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.806285 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.806481 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.806693 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.806818 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.806951 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.807073 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.807215 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.807383 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.807510 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.807693 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.807816 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.807999 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.808126 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.808314 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.808439 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.808629 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.808764 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.808933 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.809058 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.809269 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.809403 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.809576 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.809712 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.809898 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.810066 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.810247 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.810373 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.810664 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.810803 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.810988 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.811114 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.811295 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.811428 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.811618 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.811754 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.811946 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.812072 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.812252 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.812387 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.812558 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.812684 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.812867 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.812993 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.813171 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.813297 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.813485 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.813612 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.813786 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.813911 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.814118 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.814245 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.814430 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.814558 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.814731 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.814868 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.815038 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.815162 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.815342 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.815475 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.815644 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.815768 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.815947 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.816082 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.816251 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.816384 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.816572 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.816703 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.816871 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.817077 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.817207 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.817329 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.817488 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.817614 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.817796 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.817929 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.818142 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.818267 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.818450 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.818576 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.818755 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.818894 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.819061 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.819188 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.819362 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.819486 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.819664 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.819797 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.819965 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.820092 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.820302 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.820426 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.820606 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.820738 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.820924 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.821043 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.821242 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.821367 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.821566 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.821691 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.821874 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.822046 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.822220 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.822358 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.822538 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.822664 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.822852 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.822983 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.823158 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.823292 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.823469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.823595 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.823775 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.823902 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.824067 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.824200 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.824370 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.824496 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.824670 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.825297 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.825485 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.825621 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.825789 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.825920 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.826122 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.826245 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.826405 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.826533 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.826704 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.826829 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.827006 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.827131 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.827324 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.827459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.827627 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.827753 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.827929 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.828054 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.828235 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.828415 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.828547 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.828667 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.828822 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.828948 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.829122 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.829249 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.829462 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.829589 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.829763 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.829897 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.830110 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.830246 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.830436 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.830573 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.830745 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.830878 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.831070 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.831196 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.831376 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.831500 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.831692 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.831829 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.832006 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.832130 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.832319 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.832443 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.832631 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.832766 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.832945 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.833071 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.833258 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.833389 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.833618 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.833787 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.833936 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.834116 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.834270 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.834397 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.834586 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.834712 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.834900 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.835115 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.835241 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.835446 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.835731 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.835859 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.836059 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.836186 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.836369 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.836493 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.836679 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.836811 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.837024 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.837157 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.837300 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.837438 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.837612 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.837737 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.837922 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.838079 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.838257 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.838391 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.838566 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.838702 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.838877 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.839006 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.839201 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.839336 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.839521 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.839648 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.839837 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.839962 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.840158 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.840285 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.840527 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.841143 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.841340 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.841477 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.841690 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.841822 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.842026 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.842154 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.842339 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.842478 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.842656 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.842783 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.842974 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.843107 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.843285 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.843423 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.843601 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.843727 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.843913 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.844036 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.844223 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.844362 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.844533 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.844657 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.844840 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.844963 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.845149 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.845276 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.845457 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.845582 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.845763 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.845888 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.846095 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.846231 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.846398 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.846525 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.846719 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.846854 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.847055 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.847179 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.847341 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.847481 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.847654 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.847791 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.847968 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.848174 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.848300 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.848492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.848790 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.848929 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.849102 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.849228 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.849434 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.849560 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.849756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.849890 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.850084 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.850216 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.850410 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.850537 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.850715 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.850848 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.851023 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.851149 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.851329 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.851480 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.851618 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.851750 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.851926 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.852060 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.852232 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.852358 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.852534 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.852661 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.852837 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.852987 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.853150 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.853274 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.853453 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.853579 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.853769 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.854015 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.854144 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.854368 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.854621 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.854749 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.854966 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.855091 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.855279 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.855413 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.855603 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.855735 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.855917 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.856058 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.856524 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.856723 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.856878 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.857038 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.857301 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.857428 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.857607 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.857742 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.857914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.858064 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.858321 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.858459 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.858600 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.858724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.858897 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.859031 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.859207 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.859341 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.859512 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.859642 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.859827 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.859953 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.860139 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.860265 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.860457 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.860593 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.860758 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.860889 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.861074 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.861199 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.861382 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.861508 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.861693 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.861825 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.862026 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.862173 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.862332 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.862461 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.862643 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.862778 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.862955 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.863084 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.863269 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.863395 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.863570 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.863699 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.863887 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.864027 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.864198 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.864330 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.864512 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.864640 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.864812 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.864952 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.865123 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.865251 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.865428 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.865560 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.865744 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.865883 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.866124 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.866250 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.866439 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.866565 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.866745 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.866874 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.867057 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.867184 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.867380 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.867514 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.867697 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.867823 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.868006 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.868135 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.868325 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.868465 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.868633 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.868765 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.868986 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.869205 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.869331 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.869550 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.869844 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.870007 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.870214 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.870340 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.870551 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.870689 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.870871 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.870996 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.871178 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.871316 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.871496 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.871841 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.871966 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.872149 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.872275 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.872486 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.872623 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.872808 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.872940 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.873116 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.873244 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.873433 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.873566 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.873751 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.873885 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.874092 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.874220 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.874410 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.874536 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.874717 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.874854 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.875035 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.875153 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.875350 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.875476 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.875657 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.875782 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.875971 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.876109 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.876278 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.876414 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.876596 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.876738 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.876944 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.877150 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.877277 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.877397 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.877579 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.877712 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.877888 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.878085 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.878234 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.878361 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.878553 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.878678 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.878869 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.879004 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.879176 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.879302 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.879488 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.879615 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.879802 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.879935 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.880116 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.880240 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.880452 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.880577 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.880763 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.880890 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.881176 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.881301 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.881495 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.881632 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.881816 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.881941 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.882171 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.882329 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.882492 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.882632 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.882804 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.882938 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.883132 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.883257 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.883442 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.883582 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.883770 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.883902 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.884089 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.884216 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.884427 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.884562 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.884774 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.884899 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.885084 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.885215 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.885404 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.885531 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.885722 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.885848 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.886056 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.886184 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.886362 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.886488 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.886677 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.886803 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.886986 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.887122 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.887814 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.887951 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.888132 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.888297 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.888449 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.888586 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.888756 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.888892 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.889067 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.889193 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.889381 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.889514 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.889692 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.889816 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.890016 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.890406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.890587 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.890726 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.890891 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.891019 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.891205 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.891329 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.891518 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.891651 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.891822 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.891947 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.892129 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.892260 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.892440 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.892575 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.892754 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.892879 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.893056 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.893180 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.893365 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.893496 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.893674 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.893805 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.894016 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.894157 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.894322 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.894448 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.894662 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.894788 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.894999 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.895132 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.895311 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.895439 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.895687 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.895827 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.895951 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.896080 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.896277 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.896418 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.896584 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.896721 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.896913 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.897054 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.897232 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.897363 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.897552 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.897683 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.897859 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.898034 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.898205 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.898338 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.898519 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.898656 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.898837 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.898977 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.899156 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.899282 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.899475 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.899613 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.899784 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.899928 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.900101 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.900233 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.900431 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.900562 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.900769 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.900904 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.901084 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.901210 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.901405 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.901530 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.901724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.901850 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.902063 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.902203 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.902391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.902524 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.902712 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.902839 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.903576 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.903706 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.903896 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.904041 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.904212 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.904344 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.904535 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.904659 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.904853 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.904986 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.905162 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.905294 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.905486 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.905619 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.905800 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.905931 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.906147 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.906279 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.906482 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.906614 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.906802 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.906929 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.907137 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.907263 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.907461 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.907592 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.907814 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.907947 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.908135 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.908268 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.908467 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.908591 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.908790 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.908916 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.909099 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.909225 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.909347 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 10:42:33.909482 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.909709 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:42:33.909973 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 10:42:33.969221 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO dbcounter [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Registered counter for database nova_api May 23 10:42:33.969551 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO dbcounter [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Registered counter for database nova_api May 23 10:42:33.989303 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG oslo_db.sqlalchemy.engines [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:42:33.992477 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_db.sqlalchemy.engines [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:42:33.996139 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG dbcounter [-] [114598] Writer thread running {{(pid=114598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:42:33.999117 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writer thread running {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:42:34.053939 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.context [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a0b5a72-be8f-4ccc-a37a-e387d6681f68(cell1) {{(pid=114598) load_cells /opt/stack/nova/nova/context.py:464}} May 23 10:42:34.056488 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.context [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a0b5a72-be8f-4ccc-a37a-e387d6681f68(cell1) {{(pid=114599) load_cells /opt/stack/nova/nova/context.py:464}} May 23 10:42:34.058081 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG oslo_concurrency.lockutils [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:42:34.059762 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG oslo_concurrency.lockutils [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:42:34.060529 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG oslo_concurrency.lockutils [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:42:34.060796 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:42:34.062542 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:42:34.062657 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG oslo_concurrency.lockutils [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:42:34.063331 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:42:34.064634 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO dbcounter [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Registered counter for database nova_cell0 May 23 10:42:34.065288 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:42:34.067309 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO dbcounter [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Registered counter for database nova_cell0 May 23 10:42:34.068718 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO dbcounter [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Registered counter for database nova_cell1 May 23 10:42:34.071247 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO dbcounter [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Registered counter for database nova_cell1 May 23 10:42:34.077366 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG oslo_db.sqlalchemy.engines [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:42:34.081008 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG oslo_db.sqlalchemy.engines [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:42:34.082460 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_db.sqlalchemy.engines [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:42:34.084614 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_db.sqlalchemy.engines [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:42:34.087904 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG dbcounter [-] [114598] Writer thread running {{(pid=114598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:42:34.089141 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG dbcounter [-] [114598] Writer thread running {{(pid=114598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:42:34.089984 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writer thread running {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:42:34.092592 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writer thread running {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:42:34.243698 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO dbcounter [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Registered counter for database nova_cell0 May 23 10:42:34.244389 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO dbcounter [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Registered counter for database nova_cell0 May 23 10:42:34.253764 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG oslo_db.sqlalchemy.engines [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:42:34.257327 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_db.sqlalchemy.engines [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:42:34.258182 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG dbcounter [-] [114598] Writer thread running {{(pid=114598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:42:34.261807 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writer thread running {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:42:34.597656 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: WARNING keystonemiddleware.auth_token [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 10:42:34.599214 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: WARNING keystonemiddleware.auth_token [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 10:42:34.604890 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: WARNING keystonemiddleware.auth_token [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 10:42:34.606930 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: WARNING keystonemiddleware.auth_token [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 10:42:34.947933 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: WARNING keystonemiddleware.auth_token [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 10:42:34.948619 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: WARNING keystonemiddleware.auth_token [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 10:42:34.953829 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: WARNING keystonemiddleware.auth_token [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 10:42:34.954632 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: WARNING keystonemiddleware.auth_token [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 10:42:34.959232 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b2d5d759c0 pid: 114598 (default app) May 23 10:42:34.959896 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b2d5d759c0 pid: 114599 (default app) May 23 10:42:34.961269 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:42:34.962465 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-ebcc6e22-4fe2-4b18-8c2e-e035cc5fb72c None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 May 23 10:42:34.962873 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Mon May 23 10:42:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:43:51.657286 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:43:51.658511 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 May 23 10:43:51.658904 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:43:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:43:51.670023 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG dbcounter [-] [114598] Writing DB stats nova_api:SELECT=3 {{(pid=114598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:43:51.671139 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG dbcounter [-] [114598] Writing DB stats nova_cell0:SELECT=3 {{(pid=114598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:43:51.672226 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG dbcounter [-] [114598] Writing DB stats nova_cell1:SELECT=3 {{(pid=114598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:43:51.673249 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG dbcounter [-] [114598] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:43:52.085309 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-d00018ea-aa47-46e0-9faa-5e98b7313820 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:43:52.116349 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-d00018ea-aa47-46e0-9faa-5e98b7313820 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.451387 May 23 10:43:52.126045 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1291 bytes} [Mon May 23 10:43:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:43:54.345581 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:43:54.346551 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-82cda386-7e67-4fd4-8f8c-0d5fffa62735 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 23 10:43:54.346955 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:43:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:43:54.410607 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-027d6b4b-65d1-45b3-9eaf-081dec22353b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "id": "c1", "swap": 0, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:43:54.429272 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 10:43:54.429272 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: warnings.warn(msg) May 23 10:43:54.459239 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-027d6b4b-65d1-45b3-9eaf-081dec22353b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106046 May 23 10:43:54.460604 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1282 bytes} [Mon May 23 10:43:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:43:54.473942 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writing DB stats nova_api:SELECT=3 {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:43:54.474903 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writing DB stats nova_cell1:SELECT=3 {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:43:54.476421 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writing DB stats nova_cell0:SELECT=3 {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:43:54.477371 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:43:54.693908 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-a71648af-ef92-4892-bde6-6fa1e67cf23f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:43:54.696986 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 10:43:54.696986 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: warnings.warn(msg) May 23 10:43:54.767398 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-a71648af-ef92-4892-bde6-6fa1e67cf23f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298759 May 23 10:43:54.768268 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1335 bytes} [Mon May 23 10:43:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:43:57.004611 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-027d6b4b-65d1-45b3-9eaf-081dec22353b admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:43:57.005620 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-027d6b4b-65d1-45b3-9eaf-081dec22353b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 23 10:43:57.006054 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:43:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:43:57.144309 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-25d86792-a1ee-4d2a-8f4a-6f7d4bb5fe6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:43:57.162196 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 10:43:57.162196 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: warnings.warn(msg) May 23 10:43:57.180152 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-25d86792-a1ee-4d2a-8f4a-6f7d4bb5fe6e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.167449 May 23 10:43:57.180700 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1282 bytes} [Mon May 23 10:43:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:43:57.193099 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-61c3d582-7551-4478-b5c4-4cb09f5b95e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:43:57.194544 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 10:43:57.194544 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: warnings.warn(msg) May 23 10:43:57.225630 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-61c3d582-7551-4478-b5c4-4cb09f5b95e9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036108 May 23 10:43:57.226248 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1335 bytes} [Mon May 23 10:43:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:43:59.479087 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-25d86792-a1ee-4d2a-8f4a-6f7d4bb5fe6e admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:43:59.480682 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-25d86792-a1ee-4d2a-8f4a-6f7d4bb5fe6e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002592 May 23 10:43:59.481103 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:43:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:43:59.543198 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-208ed7a0-7f5d-4cb1-9f6d-b0f81a2279d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:43:59.562518 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-208ed7a0-7f5d-4cb1-9f6d-b0f81a2279d7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075382 May 23 10:43:59.563244 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1282 bytes} [Mon May 23 10:43:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:43:59.575516 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-14369174-ce8c-4066-a52f-8398d5f45323 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:43:59.602341 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-14369174-ce8c-4066-a52f-8398d5f45323 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030901 May 23 10:43:59.606054 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1335 bytes} [Mon May 23 10:43:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:44:01.876220 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-208ed7a0-7f5d-4cb1-9f6d-b0f81a2279d7 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:01.877327 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-208ed7a0-7f5d-4cb1-9f6d-b0f81a2279d7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 May 23 10:44:01.877741 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:44:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:01.939513 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-33de363c-3212-4e0e-9521-5b914abe1ed2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:01.959816 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-33de363c-3212-4e0e-9521-5b914abe1ed2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075468 May 23 10:44:01.960375 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1282 bytes} [Mon May 23 10:44:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:44:01.972839 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-343bd437-92bc-4142-b6de-80056370bc91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:02.002483 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-343bd437-92bc-4142-b6de-80056370bc91 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033060 May 23 10:44:02.003236 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1335 bytes} [Mon May 23 10:44:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:44:04.297937 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-33de363c-3212-4e0e-9521-5b914abe1ed2 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:04.298970 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-33de363c-3212-4e0e-9521-5b914abe1ed2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 23 10:44:04.300216 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:44:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:04.360316 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-50dec646-b419-4fd1-8c1d-484863fb793b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "swap": 0}} {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:04.378850 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-50dec646-b419-4fd1-8c1d-484863fb793b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072464 May 23 10:44:04.379761 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1282 bytes} [Mon May 23 10:44:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:44:04.392672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-8939a152-40f5-471a-ab84-94681aafa71d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:04.416711 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-8939a152-40f5-471a-ab84-94681aafa71d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028085 May 23 10:44:04.417275 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1335 bytes} [Mon May 23 10:44:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:44:06.651770 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-50dec646-b419-4fd1-8c1d-484863fb793b admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:06.652774 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-50dec646-b419-4fd1-8c1d-484863fb793b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 23 10:44:06.653171 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:06.713500 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-bb764197-80a3-4dbe-8a14-b7b4c1ed1ea8 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:06.736694 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-bb764197-80a3-4dbe-8a14-b7b4c1ed1ea8 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077565 May 23 10:44:06.738130 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1291 bytes} [Mon May 23 10:44:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:44:09.177032 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-50dec646-b419-4fd1-8c1d-484863fb793b admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:09.178159 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-50dec646-b419-4fd1-8c1d-484863fb793b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 May 23 10:44:09.178640 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:09.248738 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-71186434-2d95-4a3c-a342-abd1a1227deb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:09.266783 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-71186434-2d95-4a3c-a342-abd1a1227deb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081370 May 23 10:44:09.267420 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1282 bytes} [Mon May 23 10:44:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:44:09.279047 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-adef606c-d4a8-400f-bf96-7400278a4093 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:09.302239 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-adef606c-d4a8-400f-bf96-7400278a4093 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026826 May 23 10:44:09.303016 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1332 bytes} [Mon May 23 10:44:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:44:11.544941 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-71186434-2d95-4a3c-a342-abd1a1227deb admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:11.545999 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-71186434-2d95-4a3c-a342-abd1a1227deb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 23 10:44:11.546383 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:44:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:11.605202 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-a02babb1-a94f-4f01-8677-cd8a9dace317 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:11.622961 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-a02babb1-a94f-4f01-8677-cd8a9dace317 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070793 May 23 10:44:11.623514 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1282 bytes} [Mon May 23 10:44:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:44:11.635917 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-15454c6c-e837-4e31-8378-5b61226ce84e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:11.661757 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-15454c6c-e837-4e31-8378-5b61226ce84e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029960 May 23 10:44:11.662375 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1332 bytes} [Mon May 23 10:44:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:44:13.979780 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-a02babb1-a94f-4f01-8677-cd8a9dace317 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:13.981440 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-a02babb1-a94f-4f01-8677-cd8a9dace317 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003134 May 23 10:44:13.982188 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:44:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:14.051681 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-15e5355b-07fe-45aa-8e45-2a1b1bf9127d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "id": "3", "ram": 4096, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:14.069315 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-15e5355b-07fe-45aa-8e45-2a1b1bf9127d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077678 May 23 10:44:14.069872 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1282 bytes} [Mon May 23 10:44:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:44:14.086574 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-60261c71-f47f-41a8-a883-986a5b9b497a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:14.110052 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-60261c71-f47f-41a8-a883-986a5b9b497a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027980 May 23 10:44:14.110636 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1332 bytes} [Mon May 23 10:44:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:44:16.355679 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-15e5355b-07fe-45aa-8e45-2a1b1bf9127d admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:16.356692 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-15e5355b-07fe-45aa-8e45-2a1b1bf9127d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 23 10:44:16.357095 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:44:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:16.414631 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-46cd01a1-2d00-4f44-bdc3-36ddb2a9eed0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:16.432844 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-46cd01a1-2d00-4f44-bdc3-36ddb2a9eed0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069789 May 23 10:44:16.434083 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1282 bytes} [Mon May 23 10:44:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 10:44:16.445513 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-9aea0657-82d4-45d9-8086-4fd3d49c9da5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:16.468398 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-9aea0657-82d4-45d9-8086-4fd3d49c9da5 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026487 May 23 10:44:16.468962 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1332 bytes} [Mon May 23 10:44:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:44:18.716760 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-46cd01a1-2d00-4f44-bdc3-36ddb2a9eed0 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:18.717874 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-46cd01a1-2d00-4f44-bdc3-36ddb2a9eed0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 May 23 10:44:18.718393 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:18.784214 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-6293739e-635f-4fe1-89ad-3fb312db7292 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:18.803046 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-6293739e-635f-4fe1-89ad-3fb312db7292 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078690 May 23 10:44:18.803690 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1282 bytes} [Mon May 23 10:44:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:44:18.815465 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-d1bde642-f7e4-4431-add1-7bbd4c3079b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:18.844650 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-d1bde642-f7e4-4431-add1-7bbd4c3079b9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032819 May 23 10:44:18.846330 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1332 bytes} [Mon May 23 10:44:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:44:43.505255 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-6293739e-635f-4fe1-89ad-3fb312db7292 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:43.506250 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-6293739e-635f-4fe1-89ad-3fb312db7292 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 23 10:44:43.506650 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:44:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:44:43.517690 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG dbcounter [-] [114598] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=114598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:44:43.567052 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-f90a1a75-00a3-4c6c-bf7c-2dbab11c8b62 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:43.583645 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-f90a1a75-00a3-4c6c-bf7c-2dbab11c8b62 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070735 May 23 10:44:43.584172 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1291 bytes} [Mon May 23 10:44:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:44:44.563396 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-6293739e-635f-4fe1-89ad-3fb312db7292 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:44.564387 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-6293739e-635f-4fe1-89ad-3fb312db7292 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 23 10:44:44.564788 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:44:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:44:44.777870 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-561c06b9-aca9-4c26-9f48-409bdfffabfc admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:44.783511 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.wsgi [None req-561c06b9-aca9-4c26-9f48-409bdfffabfc admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-561c06b9-aca9-4c26-9f48-409bdfffabfc admin admin] Request method failure captured: May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Accept: application/json May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Accept-Encoding: gzip, deflate May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Connection: keep-alive May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Content-Length: 0 May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Host: 10.222.0.36 May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Openstack-Api-Version: compute 2.90 May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Openstack-System-Scope: None May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: User-Agent: python-novaclient May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Auth-Token: gAAAAABii2WciJfNKfOBAa9U_t5vgQy_MC9rqFWEvhmwp0ejIbzaAZe2_DRU4mcfwHPO3esB7CktlPXd_NFp2V_SxG66g4_qs7NqRMDNrPV2WctFnRJbnfuifp45eJlULpj_VQa-mgINlFUdcWLK8zOknOGG2FGpISoUIyIZwM8dikNCbr35sxU May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Domain-Id: None May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Domain-Name: None May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Identity-Status: Confirmed May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Is-Admin-Project: True May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Openstack-Nova-Api-Version: 2.90 May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Domain-Id: default May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Domain-Name: Default May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Name: admin May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Role: reader,member,admin May 23 10:44:44.786746 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Roles: reader,member,admin May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6dd918cb8494a52af5c7b9bb5c60e89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Tenant: admin May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Tenant-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Tenant-Name: admin May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User: admin May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Domain-Id: default May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Domain-Name: Default May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Id: eb9753922dc94eb786d2155e45d2454a May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Name: admin May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: method: > May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: exception: Flavor 42 could not be found. May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: action_args: {'id': '42'} May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:44:44.788415 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:44.789469 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:44.791625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-561c06b9-aca9-4c26-9f48-409bdfffabfc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:44:44.792912 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-561c06b9-aca9-4c26-9f48-409bdfffabfc admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060821 May 23 10:44:44.792912 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Mon May 23 10:44:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 10:44:44.798815 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-b0d4d1dd-b32b-41f3-873c-3914932d38bb admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:44.801901 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:44:44.821253 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-b0d4d1dd-b32b-41f3-873c-3914932d38bb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025995 May 23 10:44:44.821802 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Mon May 23 10:44:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:44:44.831481 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-3bdfe0b2-5f8f-4a99-988d-86de0034ed6e admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:44.853969 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-3bdfe0b2-5f8f-4a99-988d-86de0034ed6e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026018 May 23 10:44:44.854512 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Mon May 23 10:44:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:44:44.863826 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-b7d9101c-4a0a-43a1-8b3c-32e2667d9c3c admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:44.869929 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.wsgi [None req-b7d9101c-4a0a-43a1-8b3c-32e2667d9c3c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-b7d9101c-4a0a-43a1-8b3c-32e2667d9c3c admin admin] Request method failure captured: May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Accept: application/json May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Accept-Encoding: gzip, deflate May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Connection: keep-alive May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Content-Length: 0 May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Host: 10.222.0.36 May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Openstack-Api-Version: compute 2.90 May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Openstack-System-Scope: None May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: User-Agent: python-novaclient May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Auth-Token: gAAAAABii2WciJfNKfOBAa9U_t5vgQy_MC9rqFWEvhmwp0ejIbzaAZe2_DRU4mcfwHPO3esB7CktlPXd_NFp2V_SxG66g4_qs7NqRMDNrPV2WctFnRJbnfuifp45eJlULpj_VQa-mgINlFUdcWLK8zOknOGG2FGpISoUIyIZwM8dikNCbr35sxU May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Domain-Id: None May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Domain-Name: None May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Identity-Status: Confirmed May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Is-Admin-Project: True May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Openstack-Nova-Api-Version: 2.90 May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Domain-Id: default May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Domain-Name: Default May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Name: admin May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Role: reader,member,admin May 23 10:44:44.873126 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Roles: reader,member,admin May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6dd918cb8494a52af5c7b9bb5c60e89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Tenant: admin May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Tenant-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Tenant-Name: admin May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User: admin May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Domain-Id: default May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Domain-Name: Default May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Id: eb9753922dc94eb786d2155e45d2454a May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Name: admin May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: method: > May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: exception: Flavor 42 could not be found. May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: action_args: {'id': '42'} May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:44:44.874724 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:44.875714 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:44.877041 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-b7d9101c-4a0a-43a1-8b3c-32e2667d9c3c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:44:44.878330 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-b7d9101c-4a0a-43a1-8b3c-32e2667d9c3c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014307 May 23 10:44:44.878330 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Mon May 23 10:44:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 10:44:45.733739 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-3bdfe0b2-5f8f-4a99-988d-86de0034ed6e admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:45.734831 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-3bdfe0b2-5f8f-4a99-988d-86de0034ed6e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 23 10:44:45.735318 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:44:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:45.922975 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-14e07f59-6a3a-4933-ba41-91fa94874992 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:45.928765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.wsgi [None req-14e07f59-6a3a-4933-ba41-91fa94874992 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-14e07f59-6a3a-4933-ba41-91fa94874992 admin admin] Request method failure captured: May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Accept: application/json May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Accept-Encoding: gzip, deflate May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Connection: keep-alive May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Content-Length: 0 May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Host: 10.222.0.36 May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Openstack-Api-Version: compute 2.90 May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Openstack-System-Scope: None May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: User-Agent: python-novaclient May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Auth-Token: gAAAAABii2Wd-ydmUyHnrPMdAwMFyLmtoYvRu-fBc3kHRHDbx_lic9ULKAyENZnTDBFuclCsVa5PfqDZ1Ct4W2RK_0bCkonvQcBPtuNMAUd7rX__bGPDJtv4LqAsbtDEtKwZCO4K71oCWaTSmUK0UeEZLf11VmlMXmaTodOAMT1Gg7y7PceU1hI May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Domain-Id: None May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Domain-Name: None May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Identity-Status: Confirmed May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Is-Admin-Project: True May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Openstack-Nova-Api-Version: 2.90 May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Domain-Id: default May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Domain-Name: Default May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Name: admin May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Role: reader,member,admin May 23 10:44:45.930299 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Roles: reader,member,admin May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6dd918cb8494a52af5c7b9bb5c60e89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Tenant: admin May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Tenant-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Tenant-Name: admin May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User: admin May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Domain-Id: default May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Domain-Name: Default May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Id: eb9753922dc94eb786d2155e45d2454a May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Name: admin May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: method: > May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: exception: Flavor 84 could not be found. May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: action_args: {'id': '84'} May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:44:45.932408 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:45.933391 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:45.934765 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-14e07f59-6a3a-4933-ba41-91fa94874992 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:44:45.936045 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-14e07f59-6a3a-4933-ba41-91fa94874992 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060655 May 23 10:44:45.936045 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Mon May 23 10:44:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 10:44:45.941987 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-55fd75c6-aa79-4e93-a2e5-47a1e5fa01d1 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:45.956914 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-55fd75c6-aa79-4e93-a2e5-47a1e5fa01d1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018412 May 23 10:44:45.957396 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Mon May 23 10:44:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:44:45.966461 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-208c848a-5577-40c7-ab22-36025326cd01 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:45.981934 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-208c848a-5577-40c7-ab22-36025326cd01 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018935 May 23 10:44:45.982474 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Mon May 23 10:44:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:44:45.991341 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-9211c564-8687-4951-873c-06c828541f80 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:45.997170 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.wsgi [None req-9211c564-8687-4951-873c-06c828541f80 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-9211c564-8687-4951-873c-06c828541f80 admin admin] Request method failure captured: May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Accept: application/json May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Accept-Encoding: gzip, deflate May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Connection: keep-alive May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Content-Length: 0 May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Host: 10.222.0.36 May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Openstack-Api-Version: compute 2.90 May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Openstack-System-Scope: None May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: User-Agent: python-novaclient May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Auth-Token: gAAAAABii2Wd-ydmUyHnrPMdAwMFyLmtoYvRu-fBc3kHRHDbx_lic9ULKAyENZnTDBFuclCsVa5PfqDZ1Ct4W2RK_0bCkonvQcBPtuNMAUd7rX__bGPDJtv4LqAsbtDEtKwZCO4K71oCWaTSmUK0UeEZLf11VmlMXmaTodOAMT1Gg7y7PceU1hI May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Domain-Id: None May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Domain-Name: None May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Identity-Status: Confirmed May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Is-Admin-Project: True May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Openstack-Nova-Api-Version: 2.90 May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Domain-Id: default May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Domain-Name: Default May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Name: admin May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Role: reader,member,admin May 23 10:44:45.998695 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Roles: reader,member,admin May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6dd918cb8494a52af5c7b9bb5c60e89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Tenant: admin May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Tenant-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Tenant-Name: admin May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User: admin May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Domain-Id: default May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Domain-Name: Default May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Id: eb9753922dc94eb786d2155e45d2454a May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Name: admin May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: method: > May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: exception: Flavor 84 could not be found. May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: action_args: {'id': '84'} May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:44:46.000459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:46.001406 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:46.002756 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-9211c564-8687-4951-873c-06c828541f80 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:44:46.004072 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-9211c564-8687-4951-873c-06c828541f80 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012182 May 23 10:44:46.004072 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Mon May 23 10:44:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 10:44:46.854245 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-208c848a-5577-40c7-ab22-36025326cd01 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:46.855236 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-208c848a-5577-40c7-ab22-36025326cd01 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 23 10:44:46.855630 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:44:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:47.042198 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-a34c0a72-8dea-4ee0-b43c-a5f880babced admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:47.047992 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.wsgi [None req-a34c0a72-8dea-4ee0-b43c-a5f880babced admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-a34c0a72-8dea-4ee0-b43c-a5f880babced admin admin] Request method failure captured: May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Accept: application/json May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Accept-Encoding: gzip, deflate May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Connection: keep-alive May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Content-Length: 0 May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Host: 10.222.0.36 May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Openstack-Api-Version: compute 2.90 May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Openstack-System-Scope: None May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: User-Agent: python-novaclient May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Auth-Token: gAAAAABii2Weq90biL-7dHSJ19nZsJu_anJBavqC6Cd-iS_IQMyutN0IJ-Dg5tF10I0DtRIau9ALxHO3u1TzFsH1BvUePuCnZf99ddVAEuSkPj5TbtSa4bwPeq61tacZXSkyiKuqPCqDQsfNKbIHMOnzYbIxqD38rEiIMsXU73Ha-lujwUqrOow May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Domain-Id: None May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Domain-Name: None May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Identity-Status: Confirmed May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Is-Admin-Project: True May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Openstack-Nova-Api-Version: 2.90 May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Domain-Id: default May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Domain-Name: Default May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Project-Name: admin May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Role: reader,member,admin May 23 10:44:47.049492 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Roles: reader,member,admin May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6dd918cb8494a52af5c7b9bb5c60e89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Tenant: admin May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Tenant-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-Tenant-Name: admin May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User: admin May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Domain-Id: default May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Domain-Name: Default May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Id: eb9753922dc94eb786d2155e45d2454a May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: X-User-Name: admin May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: method: > May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: exception: Flavor 451 could not be found. May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: action_args: {'id': '451'} May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:44:47.051104 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:47.052183 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: ERROR nova.api.openstack.wsgi May 23 10:44:47.053625 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-a34c0a72-8dea-4ee0-b43c-a5f880babced admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:44:47.054919 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-a34c0a72-8dea-4ee0-b43c-a5f880babced admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059422 May 23 10:44:47.054919 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Mon May 23 10:44:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 10:44:47.061346 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-c77a5c79-381d-46a6-8e7d-58a17577ac66 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:47.075495 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-c77a5c79-381d-46a6-8e7d-58a17577ac66 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017599 May 23 10:44:47.075957 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Mon May 23 10:44:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:44:47.084948 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:47.098278 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016752 May 23 10:44:47.098795 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Mon May 23 10:44:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:44:47.107538 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-211e4890-5431-494c-86a2-1fb6d6286df5 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:47.112626 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.wsgi [None req-211e4890-5431-494c-86a2-1fb6d6286df5 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-211e4890-5431-494c-86a2-1fb6d6286df5 admin admin] Request method failure captured: May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Accept: application/json May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Accept-Encoding: gzip, deflate May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Connection: keep-alive May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Content-Length: 0 May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Host: 10.222.0.36 May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Openstack-Api-Version: compute 2.90 May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Openstack-System-Scope: None May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: User-Agent: python-novaclient May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Auth-Token: gAAAAABii2Weq90biL-7dHSJ19nZsJu_anJBavqC6Cd-iS_IQMyutN0IJ-Dg5tF10I0DtRIau9ALxHO3u1TzFsH1BvUePuCnZf99ddVAEuSkPj5TbtSa4bwPeq61tacZXSkyiKuqPCqDQsfNKbIHMOnzYbIxqD38rEiIMsXU73Ha-lujwUqrOow May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Domain-Id: None May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Domain-Name: None May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Identity-Status: Confirmed May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Is-Admin-Project: True May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Openstack-Nova-Api-Version: 2.90 May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Domain-Id: default May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Domain-Name: Default May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Project-Name: admin May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Role: reader,member,admin May 23 10:44:47.114121 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Roles: reader,member,admin May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6dd918cb8494a52af5c7b9bb5c60e89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6dd918cb8494a52af5c7b9bb5c60e89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Tenant: admin May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Tenant-Id: a6dd918cb8494a52af5c7b9bb5c60e89 May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-Tenant-Name: admin May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User: admin May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Domain-Id: default May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Domain-Name: Default May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Id: eb9753922dc94eb786d2155e45d2454a May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: X-User-Name: admin May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: method: > May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: exception: Flavor 451 could not be found. May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: action_args: {'id': '451'} May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:44:47.115646 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:47.116672 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: ERROR nova.api.openstack.wsgi May 23 10:44:47.117914 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-211e4890-5431-494c-86a2-1fb6d6286df5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:44:47.119692 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-211e4890-5431-494c-86a2-1fb6d6286df5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011326 May 23 10:44:47.119692 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Mon May 23 10:44:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 10:44:47.971844 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:47.972845 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 23 10:44:47.973245 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:44:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:48.158081 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-61aa6ad7-bdc7-4c18-940e-4cfc6bff1fc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:48.176148 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-61aa6ad7-bdc7-4c18-940e-4cfc6bff1fc9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068751 May 23 10:44:48.176693 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Mon May 23 10:44:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:44:49.034982 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:49.035970 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 May 23 10:44:49.036363 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:49.223445 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-8d57a45d-042e-40ab-932a-739797ed8bed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:49.241249 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-8d57a45d-042e-40ab-932a-739797ed8bed admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068732 May 23 10:44:49.241795 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Mon May 23 10:44:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 10:44:50.100127 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:50.101177 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 23 10:44:50.101578 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:44:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:50.288976 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-26b1d5d1-d6ac-4842-ab63-5ac3580c6641 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:50.307763 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-26b1d5d1-d6ac-4842-ab63-5ac3580c6641 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069438 May 23 10:44:50.308296 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Mon May 23 10:44:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:44:51.183340 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:51.184324 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 May 23 10:44:51.184711 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:44:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:51.369706 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-71f76393-dd5a-4fca-b172-f797b20b929a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:44:51.386874 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-71f76393-dd5a-4fca-b172-f797b20b929a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067675 May 23 10:44:51.387407 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Mon May 23 10:44:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:44:52.237726 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:52.238806 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 May 23 10:44:52.239209 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:44:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:44:52.424001 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-7bbb4198-a303-4629-b265-956ae64d54aa admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:44:52.443359 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-7bbb4198-a303-4629-b265-956ae64d54aa admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070076 May 23 10:44:52.443879 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Mon May 23 10:44:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:45:53.576364 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:45:53.577352 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-4fa46fac-9884-42e7-b693-766829369fc5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 May 23 10:45:53.577771 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 930 bytes} [Mon May 23 10:45:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:45:53.585192 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:45:53.637667 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-e5461625-693f-46a5-bc08-26d7a5d40701 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:45:53.656737 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-e5461625-693f-46a5-bc08-26d7a5d40701 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073040 May 23 10:45:53.657266 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1291 bytes} [Mon May 23 10:45:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:45:53.677645 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG dbcounter [-] [114598] Writing DB stats nova_api:SELECT=14 {{(pid=114598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:45:53.682011 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-9802ce4d-607b-4d87-b171-5b5cd14d90d7 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:45:53.689552 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-9802ce4d-607b-4d87-b171-5b5cd14d90d7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013348 May 23 10:45:53.690084 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1282 bytes} [Mon May 23 10:45:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:45:53.701865 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-5345248e-ca87-4fd4-a9dc-39b7e456e054 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:45:53.709238 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-5345248e-ca87-4fd4-a9dc-39b7e456e054 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011042 May 23 10:45:53.709772 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1285 bytes} [Mon May 23 10:45:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:45:53.720438 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-abe1567a-9db4-4723-954f-75e5fe02a1f9 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:45:53.727653 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-abe1567a-9db4-4723-954f-75e5fe02a1f9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010582 May 23 10:45:53.728157 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1285 bytes} [Mon May 23 10:45:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:45:53.740057 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-50daf861-5b83-4f36-9a04-dc1b09cd3cbc admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:45:53.748017 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-50daf861-5b83-4f36-9a04-dc1b09cd3cbc admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011405 May 23 10:45:53.748525 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1282 bytes} [Mon May 23 10:45:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:49:34.155670 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-abe1567a-9db4-4723-954f-75e5fe02a1f9 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:49:34.156666 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-abe1567a-9db4-4723-954f-75e5fe02a1f9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 23 10:49:34.157060 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:49:34.312727 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writing DB stats nova_api:SELECT=6 {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:49:34.425498 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-bb2889d2-8b9a-475e-bbc9-848cc31da9d7 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:49:34.426768 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 10:49:34.426768 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: warnings.warn(msg) May 23 10:49:34.428663 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-bb2889d2-8b9a-475e-bbc9-848cc31da9d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:49:34.429149 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-bb2889d2-8b9a-475e-bbc9-848cc31da9d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:49:34.430044 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-bb2889d2-8b9a-475e-bbc9-848cc31da9d7 admin admin] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:49:34.430516 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-bb2889d2-8b9a-475e-bbc9-848cc31da9d7 admin admin] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:49:34.463021 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-bb2889d2-8b9a-475e-bbc9-848cc31da9d7 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.151707 May 23 10:49:34.463832 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Mon May 23 10:49:34 2022] GET /compute/v2.1/os-services => generated 794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:49:35.336334 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-abe1567a-9db4-4723-954f-75e5fe02a1f9 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:49:35.337337 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-abe1567a-9db4-4723-954f-75e5fe02a1f9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 23 10:49:35.337732 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:49:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:49:35.526515 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-5e2094ca-088d-47a5-9b81-07cfd5e509fb admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:49:35.527682 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 10:49:35.527682 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: warnings.warn(msg) May 23 10:49:35.528853 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-5e2094ca-088d-47a5-9b81-07cfd5e509fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:49:35.529288 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-5e2094ca-088d-47a5-9b81-07cfd5e509fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:49:35.530118 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-5e2094ca-088d-47a5-9b81-07cfd5e509fb admin admin] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:49:35.530542 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-5e2094ca-088d-47a5-9b81-07cfd5e509fb admin admin] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:49:35.549399 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-5e2094ca-088d-47a5-9b81-07cfd5e509fb admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074203 May 23 10:49:35.549935 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Mon May 23 10:49:35 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:49:46.823982 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-abe1567a-9db4-4723-954f-75e5fe02a1f9 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:49:46.824990 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-abe1567a-9db4-4723-954f-75e5fe02a1f9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 23 10:49:46.825392 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:49:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:49:46.965210 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writing DB stats nova_cell0:SELECT=4 {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:49:46.965923 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writing DB stats nova_cell1:SELECT=4 {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:49:46.966537 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG dbcounter [-] [114599] Writing DB stats nova_api:SELECT=8 {{(pid=114599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:49:47.015117 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-4ada7e00-c76a-4f0b-8e87-86ade17b1ff1 admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:49:47.016287 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 10:49:47.016287 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: warnings.warn(msg) May 23 10:49:47.017466 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-4ada7e00-c76a-4f0b-8e87-86ade17b1ff1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:49:47.017901 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-4ada7e00-c76a-4f0b-8e87-86ade17b1ff1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:49:47.018711 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-4ada7e00-c76a-4f0b-8e87-86ade17b1ff1 admin admin] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:49:47.019135 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-4ada7e00-c76a-4f0b-8e87-86ade17b1ff1 admin admin] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:49:47.043426 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-4ada7e00-c76a-4f0b-8e87-86ade17b1ff1 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082604 May 23 10:49:47.043962 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Mon May 23 10:49:46 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:49:47.908995 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: DEBUG nova.api.openstack.wsgi [None req-abe1567a-9db4-4723-954f-75e5fe02a1f9 admin admin] Calling method '>' {{(pid=114598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:49:47.910060 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: INFO nova.api.openstack.requestlog [None req-abe1567a-9db4-4723-954f-75e5fe02a1f9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 23 10:49:47.910459 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: [pid: 114598|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Mon May 23 10:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:49:48.099521 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG nova.api.openstack.wsgi [None req-386a78b4-58b8-4dec-8708-350f98e65b5e admin admin] Calling method '>' {{(pid=114599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:49:48.100706 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 10:49:48.100706 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: warnings.warn(msg) May 23 10:49:48.101885 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-386a78b4-58b8-4dec-8708-350f98e65b5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:49:48.102362 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-386a78b4-58b8-4dec-8708-350f98e65b5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:49:48.103176 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-386a78b4-58b8-4dec-8708-350f98e65b5e admin admin] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:49:48.103601 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: DEBUG oslo_concurrency.lockutils [None req-386a78b4-58b8-4dec-8708-350f98e65b5e admin admin] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:49:48.124539 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: INFO nova.api.openstack.requestlog [None req-386a78b4-58b8-4dec-8708-350f98e65b5e admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.076455 May 23 10:49:48.125023 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: [pid: 114599|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Mon May 23 10:49:48 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:50:48.817229 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: Mon May 23 10:50:48 2022 - graceful shutdown triggered... May 23 10:50:48.817755 dv-cinder-836996-25-iscsi devstack@n-api.service[114599]: Gracefully killing worker 2 (pid: 114599)... May 23 10:50:48.817356 dv-cinder-836996-25-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 23 10:50:48.818661 dv-cinder-836996-25-iscsi devstack@n-api.service[114598]: Gracefully killing worker 1 (pid: 114598)... May 23 10:50:49.817862 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: worker 1 buried after 1 seconds May 23 10:50:49.817862 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: worker 2 buried after 1 seconds May 23 10:50:49.818524 dv-cinder-836996-25-iscsi devstack@n-api.service[114597]: goodbye to uWSGI. May 23 10:50:49.819413 dv-cinder-836996-25-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 23 10:50:49.819979 dv-cinder-836996-25-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 23 10:50:49.822689 dv-cinder-836996-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 10:50:49.841377 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 10:50:49.863443 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 10:50:49 2022] *** May 23 10:50:49.864105 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 10:50:49.864260 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 10:50:49.864377 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: nodename: dv-cinder-836996-25-iscsi May 23 10:50:49.864486 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: machine: x86_64 May 23 10:50:49.864595 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: clock source: unix May 23 10:50:49.864704 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: pcre jit disabled May 23 10:50:49.864887 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: detected number of CPU cores: 4 May 23 10:50:49.864996 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: current working directory: / May 23 10:50:49.865118 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: detected binary path: /usr/bin/uwsgi-core May 23 10:50:49.865233 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: your processes number limit is 47680 May 23 10:50:49.865344 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: your memory page size is 4096 bytes May 23 10:50:49.865452 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: detected max file descriptor number: 2048 May 23 10:50:49.865561 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: lock engine: pthread robust mutexes May 23 10:50:49.865839 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: thunder lock: enabled May 23 10:50:49.866177 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 10:50:49.866392 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 10:50:49.912034 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: Python main interpreter initialized at 0x562460a1c9c0 May 23 10:50:49.912034 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: python threads support enabled May 23 10:50:49.912034 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: your server socket listen backlog is limited to 100 connections May 23 10:50:49.912034 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: your mercy for graceful operations on workers is 90 seconds May 23 10:50:49.912469 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: mapped 403077 bytes (393 KB) for 2 cores May 23 10:50:49.912469 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: *** Operational MODE: preforking *** May 23 10:50:49.912711 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: *** uWSGI is running in multiple interpreter mode *** May 23 10:50:49.912711 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: spawned uWSGI master process (pid: 129011) May 23 10:50:49.912931 dv-cinder-836996-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 10:50:49.914610 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: spawned uWSGI worker 1 (pid: 129029, cores: 1) May 23 10:50:49.914610 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: spawned uWSGI worker 2 (pid: 129030, cores: 1) May 23 10:50:49.914610 dv-cinder-836996-25-iscsi devstack@n-api.service[129011]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 10:50:51.102089 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 10:50:51.103161 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 10:50:51.901764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 10:50:51.901764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: from cryptography.utils import int_from_bytes May 23 10:50:51.902293 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 10:50:51.902293 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: from cryptography.utils import int_from_bytes May 23 10:50:51.904017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 10:50:51.904017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: from cryptography.utils import int_from_bytes May 23 10:50:51.904360 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 10:50:51.904360 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: from cryptography.utils import int_from_bytes May 23 10:50:54.328787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 10:50:54.329435 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 10:50:54.329734 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 10:50:54.329943 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 10:50:54.330231 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 10:50:54.330631 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.330964 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.331293 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.331621 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.331960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.332282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.332614 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.332940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.333276 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.333547 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.333871 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.334225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-25-iscsi {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.334561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.334875 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.335194 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.336061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.336376 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.336706 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.337020 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.337526 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.339018 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.339018 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.339018 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.339018 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.339356 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.339593 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.339901 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.340205 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.340526 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.340835 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.341245 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-25-iscsi {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.341574 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.341898 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.342252 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.342685 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.343009 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.343374 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.343938 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.344313 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.349131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.349131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.349131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.349131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.349131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.349131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.349131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.349131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.350823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.350823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.350823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.350823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.350823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.350823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.350823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.350823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.353081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.353081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.353081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.353081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.353081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.353081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.353081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.354335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.354335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.354335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.354335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.354335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.354335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.355173 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 10:50:54.355650 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.355800 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 10:50:54.355951 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.356137 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 10:50:54.356290 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.356442 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 10:50:54.356596 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.356741 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 10:50:54.356901 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.357055 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.357205 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.357354 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.357505 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.357658 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.357801 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.358064 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.358235 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.358391 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.358534 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.358685 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.358835 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.358996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.359140 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.359289 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.359440 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.359584 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.359739 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.359889 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.360045 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.360194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.360345 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.360489 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-25-iscsi {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.360644 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.360789 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.360942 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.361270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.361420 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.361564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.361722 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.361878 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.362395 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.362745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.362903 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.363056 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.363211 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.363443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.363594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.363594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.363867 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.364041 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.364348 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.364508 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.364664 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.364815 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.364970 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.365128 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.365274 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.365426 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.365569 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.365712 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.365871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.366070 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.366229 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.366381 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.366524 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.366687 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.366848 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.366993 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.367137 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.367279 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.367430 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-25-iscsi {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.367583 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.367727 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.367880 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.368024 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.368173 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.368317 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.368469 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.368636 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.368787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.368948 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.369100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.369244 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.369395 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.369539 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.369692 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.369849 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.370025 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.370176 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.370327 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.370473 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.370642 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.370789 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.370942 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.371088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.371232 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.371375 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.371534 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.371685 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.371829 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.371984 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.372151 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.372554 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.372916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.373077 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.373329 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.373576 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.373735 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.373880 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.374095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.374396 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.374560 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.374715 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.374858 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.375011 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.375164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.375320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.375470 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.375613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.375760 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.375922 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.375922 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.376213 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.376357 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.376508 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.376693 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.376857 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.377013 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.377164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.377315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.377458 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.377610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.377754 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.377898 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.378075 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.378220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.378370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.378533 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.378684 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.378837 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.378994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.379145 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.379288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.379444 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.379594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.379737 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.379889 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.380042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.380195 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.380347 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.380489 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.380639 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.380792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.380959 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.381112 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.381265 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.381265 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.381544 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.381695 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.381856 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.382038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.382196 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.382365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.382778 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.383114 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.383286 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.383447 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.383618 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.383839 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.383988 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.384134 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.384291 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.384603 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.384754 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.384907 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.385058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.385203 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.385356 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.385514 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.385665 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.385817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.386013 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.386173 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.386925 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.387080 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.387225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.387368 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.387518 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.387674 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.387674 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.387961 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.388116 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.388261 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.388404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.388632 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.388778 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.388929 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.389073 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.389223 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.389369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.389529 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.389681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.389833 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.390005 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.390177 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.390333 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.390495 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.390639 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.390782 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.390933 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.391084 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.391236 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.391390 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.391543 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.391686 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.391841 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.392001 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.392163 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.392315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.392468 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.392468 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.393057 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.393398 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.393547 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.393707 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.393868 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.394160 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.394324 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.394888 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.395055 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.395200 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.395343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.395501 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.395660 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.395812 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.395963 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.396115 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.396266 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.396936 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.397106 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.397263 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.397409 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.397575 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.397729 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.397882 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.398562 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.398711 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.398857 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.399000 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.399151 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.399303 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.399460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.399606 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.399748 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.399892 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.400053 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.400206 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.400359 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.400505 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.400505 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.400796 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.400949 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.401107 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.401251 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.401394 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.401536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.401685 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.401842 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.402080 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.402233 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.402376 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.402519 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.402661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.403104 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.403289 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.403538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.403698 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.403843 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 10:50:54.404090 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.404326 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.404496 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.404650 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.404795 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.405102 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.405254 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.405408 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.405560 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.405712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.405866 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.406031 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.406183 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.406340 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.406497 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.406654 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.406798 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.406941 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.407091 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.407247 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.407399 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.407553 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.407699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.407850 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.408003 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.408148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.408300 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.408463 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.408614 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.408758 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.408910 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.409055 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.409205 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.409350 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.409500 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.409651 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.409803 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.409986 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.410137 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.410292 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.410446 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.410590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.410742 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.410894 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.411038 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.411182 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.411333 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.411486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.411650 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.411799 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.411942 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.412092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.412243 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.412410 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.412556 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.412700 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.412851 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.413283 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.413438 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.413740 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.414560 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.414724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.414870 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.415040 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.415334 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.415495 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.415659 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.415804 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.415947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.416091 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.416244 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.416388 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.416531 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.416682 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.416834 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.416977 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.417143 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.417303 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.417459 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.417603 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.417753 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.417896 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.418149 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.418297 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.418448 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.418601 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.418753 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.418904 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.419062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.419214 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.419357 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.419518 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.419670 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.419823 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.419980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.420133 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.420283 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.420435 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.420578 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.420734 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.420880 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.421023 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.421174 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.421325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.421325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.421641 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.421794 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.421983 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.422137 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.422281 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.422425 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.422587 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.422732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.422883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.423027 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.423446 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.423598 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.424013 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.424169 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.424320 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.424490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.424793 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.424999 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.425159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.425479 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.425631 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.425776 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.425918 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.426105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.426253 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.426406 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.429075 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.429589 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.429816 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.430055 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.430227 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.430387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.430534 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.430687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.430833 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.430988 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.431134 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.431293 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.431446 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.431590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.431743 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.431907 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.432059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.432204 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.432204 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.432486 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.432646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.432799 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.432943 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.433094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.433277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.433732 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.433891 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.434154 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.434306 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.434462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.434615 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.435037 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.435202 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.435361 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.435688 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.435840 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.435992 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.436157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.436303 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.436446 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.436598 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.436742 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.436885 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.437037 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.437190 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.437334 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.437477 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.437620 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.437771 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.437928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.438108 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.438253 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.438409 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.438554 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.438706 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.438985 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.439159 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.439315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.439470 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.439622 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.439781 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.439926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.440079 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.440223 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.440373 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.440517 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.440673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.440818 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.440961 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.441111 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.441262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.441414 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.441568 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.441726 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.441876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.442061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.442208 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.442358 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.442518 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.442662 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.442807 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.442949 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.443092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.443245 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.443388 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.443874 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.444039 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.444201 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.444444 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.444607 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.444760 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.445147 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.445299 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.445442 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.445612 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.445905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.446116 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.446261 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.446414 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.446559 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.446702 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.446702 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.447009 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.447160 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.447304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.447455 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.447683 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.447860 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.448014 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.448159 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.448328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.448605 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.448765 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.448963 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.449125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.449269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.449420 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.449570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.449723 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.449875 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.450056 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.450205 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.450360 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.450504 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.450667 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.450818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.450973 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.451116 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.451116 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.451397 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.451561 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.451715 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.451868 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.452019 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.452170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.452397 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.452544 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.452694 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.452839 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.453002 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.453248 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.453410 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.453556 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.453965 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.454134 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.454134 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.454447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.454694 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.454853 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.455024 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.455264 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.455498 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.455666 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.455961 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.456123 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.456270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.456424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.456585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.456730 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.456873 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.457024 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.457169 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.457322 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.457476 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.457620 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.457779 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.457930 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.458110 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.458268 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.458413 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.458574 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.458799 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.458949 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.459108 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.459261 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.459412 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.459555 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.459719 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.459871 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.460025 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.460177 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.460321 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.460995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.461155 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.461306 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.461465 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.461618 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.461771 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.461914 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.462115 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.462293 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.462449 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.462593 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.462746 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.462890 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.463033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.463195 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.463350 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.463494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.463637 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.463802 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.464157 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.464319 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.464476 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.464627 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.464627 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.465024 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.465175 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.465415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.465663 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.465815 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.466181 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.466335 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.466493 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.466647 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.466799 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.466969 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.467128 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.467280 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.467442 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.467442 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.467737 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.467887 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.468053 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.468205 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.468365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.468523 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.468682 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.468932 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.469103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.469263 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.469429 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.469588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.469746 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.469905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.470095 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.470249 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.470249 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.470546 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.470696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.470861 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.471023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.471184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.471335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.471484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.471642 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.471801 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.471958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.474579 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.474777 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.475061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.475240 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.475426 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.475683 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.475960 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.476191 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.477008 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.477181 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.477336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.477489 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.477489 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.477795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.477971 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.478131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.478281 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.478445 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.478605 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.478769 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.478939 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.479162 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.479319 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.479479 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.479639 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.479798 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.479949 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.480107 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.480265 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.480429 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.480583 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.480793 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.480959 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.481112 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.481263 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.481414 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.481572 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.481723 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.481882 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.481882 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.482230 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.482388 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.482548 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.482709 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.482886 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.483038 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.483196 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.483347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.483347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.483347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.483347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.483347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.483347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.483347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.484568 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.484568 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.484878 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.484878 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.485284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.485447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.485599 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.485849 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.486116 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.486276 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.486428 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.486590 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.486743 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.486928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.487222 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.487383 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.487555 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.487706 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.487864 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.488100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.488254 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.488404 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.488555 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.488705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.488864 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.489024 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.489201 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.489420 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.489420 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.489729 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.489893 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.490084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.490084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.490084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.490084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.490084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.490084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.490084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.491075 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.491225 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.491374 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.491538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.491721 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.492382 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.492543 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.492702 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.492852 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.493011 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.493011 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.493299 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.493456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.493613 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.493771 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.493931 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.494144 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.494297 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.494473 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.494819 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.494979 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.495141 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.495313 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.495560 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.495725 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.495964 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.496152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.496468 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.496634 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.496797 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.496964 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.497267 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.497440 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.497593 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.497593 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.497895 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.498097 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.498250 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.498250 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.498558 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.498558 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.498863 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.499013 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.499170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.499334 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.499593 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.499754 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.499915 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.500074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.500224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.500387 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.500540 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.500696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.500848 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.501010 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.501751 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.501917 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.502127 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.502127 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.502447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.502600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.502749 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.502931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.503092 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.503257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.503419 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.503570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.503722 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.503872 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.504037 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.504197 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.504356 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.504514 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.504898 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.505066 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.505229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.505382 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.505554 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.505822 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.506007 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.506245 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.506433 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.506687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.506855 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.508334 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.508501 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.508665 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.508817 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.508969 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.509119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.509282 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.509447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.509627 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.509868 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.510091 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.510247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.510410 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.510573 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.510733 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.511062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.511230 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.511555 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.511870 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.512025 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.512183 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.512183 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.512498 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.512649 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.512805 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.512971 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.513134 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.513294 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.513454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.513607 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.513768 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.513929 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.514105 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.514275 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.514427 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.515088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.515252 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.515404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.515555 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.515726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.516159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.516420 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.516592 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.516717 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.516822 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.516918 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.517012 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.517098 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.517184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.517270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.517590 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.517691 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.517787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.517881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.517985 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518087 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518188 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518278 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518363 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518541 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518626 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518720 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518814 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518900 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.518985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.519163 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.519258 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.519352 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.519439 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.519789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.519900 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520002 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520091 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520175 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520259 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520351 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520437 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520530 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520617 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520701 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520793 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520885 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520978 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.520978 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.521144 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.521237 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.521330 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.521424 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.521519 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.521605 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.521697 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.521784 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.521875 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522003 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522109 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522286 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522371 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.522462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523717 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523807 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523894 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.523983 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.524075 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.524169 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.524261 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.524362 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.524448 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.524448 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.524838 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.524951 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.525255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.525342 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.525430 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.525502 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.525502 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.525637 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.525774 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.525876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.525999 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.526105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.526207 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.526301 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.526588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.526706 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.526795 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.526883 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.526956 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.526956 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.527099 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.527099 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.527312 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.527409 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.527503 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.527605 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.527905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.527905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.527905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.528148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.528240 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.528329 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.528424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.528511 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.528595 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.528687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.528780 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.528866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.528963 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529047 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529144 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529231 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529406 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529500 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529586 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529669 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529760 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529875 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.529875 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530077 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530176 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530263 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530354 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530440 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530537 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530631 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530717 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530801 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530893 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.530978 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531071 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531158 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531240 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531324 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531415 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531499 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531596 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531682 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531772 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531854 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.531937 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532031 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532217 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532305 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532305 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532466 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532565 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532752 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532851 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.532946 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533040 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533133 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533219 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533303 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533488 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533583 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533676 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533761 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533852 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.533852 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534044 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534145 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534233 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534325 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534411 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534502 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534587 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534683 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534794 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534887 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.534974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.535058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.535364 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.535364 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.535536 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.535632 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.535718 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.535803 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.535895 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.535989 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.536084 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.536172 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.536256 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.536348 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.536443 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.536544 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.536792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.536888 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.536983 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.537079 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.537173 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.537268 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.537354 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.537443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.537516 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.537641 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.537756 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.537864 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.537965 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.538046 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.538138 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.538240 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.538334 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.538425 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.538513 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539107 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539196 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539283 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539357 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539428 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539505 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539748 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539748 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539748 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539748 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.539990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.540072 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.540144 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.540310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.540430 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.540582 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.540774 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.540905 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.541117 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.541249 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.541455 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.541587 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.541792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.541913 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.542166 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.542257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.542845 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.542952 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.543242 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.543565 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.543814 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.544111 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.544217 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.544341 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.544510 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.544665 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.544934 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.545061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.545146 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.545415 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.545538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.545627 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.545769 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.546131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.546273 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.546458 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.546617 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.546951 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.547058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.547148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.547284 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.547395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.547622 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.547741 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.548009 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.548118 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.548267 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.548378 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.548602 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.548708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.548921 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.549076 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.549237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.549341 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.549564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.549659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.549886 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.550003 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.550230 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.550328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.550550 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.550705 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.550856 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.550999 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.551197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.551349 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.551498 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.551641 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.551787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.551936 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.552148 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.552300 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.552398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.552486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.552706 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.552801 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.553021 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.553123 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.553334 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.553435 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.553653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.553757 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.554021 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.554165 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.554881 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.555182 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.555285 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.555520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.555621 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.555842 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.555944 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.556157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.556258 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.556476 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.556729 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.556831 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.557074 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.557183 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.557401 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.557503 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.557720 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.557815 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.558113 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.558219 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.558390 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.558523 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.558716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.558818 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.559038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.559134 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.559359 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.559464 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.559676 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.559777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.559994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.560095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.560316 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.560411 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.560636 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.560731 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.560972 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.561072 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.561305 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.561399 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.561635 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.561849 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.562020 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.562291 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.562395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.562624 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.562718 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.562967 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.563075 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.563309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.563405 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.563623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.563715 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.563935 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.564042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.564256 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.564350 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.564600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.564701 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.564909 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.565016 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.565225 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.565318 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.565572 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.565672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.565860 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.565992 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.566203 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.566305 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.566523 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.566617 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.566845 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.566941 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.567184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.567296 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.567487 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.567581 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.567807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.567903 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.568126 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.568239 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.568447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.568561 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.568763 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.568857 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.569088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.569182 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.569426 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.569617 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.569756 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.569985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.570134 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.570334 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.570464 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.570672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.570768 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.571033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.571143 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.571335 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.571437 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.571663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.571767 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.572002 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.572097 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.572316 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.572411 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.572629 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.572724 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.572948 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.573048 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.573263 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.573391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.573575 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.573722 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.573910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.574092 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.574282 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.574428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.574601 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.574751 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.574931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.575085 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.575249 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.575419 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.575756 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.575879 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.576072 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.576167 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.576393 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.576488 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.576733 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.576835 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.577084 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.577184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.577410 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.577523 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.577724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.577827 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.578083 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.578197 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.578399 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.578515 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.578713 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.578817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.579030 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.579170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.579345 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.579447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.579658 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.579762 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.579968 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.580075 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.580283 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.580378 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.580595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.580689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.580905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.581003 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.581220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.581315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.581529 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.581629 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.581838 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.581962 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.582182 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.582279 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.582494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.582590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.582804 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.582974 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.583115 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.583207 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.583423 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.583524 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.583734 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.583828 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.584042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.584143 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.584358 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.584459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.584670 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.584780 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.584980 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.585081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.585289 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.585383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.585624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.585742 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.585984 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.586092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.586277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.586378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.586596 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.586699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.586927 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.587027 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.587264 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.587383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.587576 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.587708 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.587889 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.588003 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.588206 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.588320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.588521 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.588632 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.588850 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.588950 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.589171 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.589287 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.589487 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.589596 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.589827 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.589930 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.590182 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.590297 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.590522 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.590720 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.590842 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.591067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.591231 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.591396 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.591500 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.591736 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.591831 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.592076 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.592180 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.592392 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.592493 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.592705 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.592799 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.593020 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.593130 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.593351 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.593454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.593668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.593768 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.594008 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.594108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.594335 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.594441 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.594655 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.594756 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.594972 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.595069 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.595289 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.595385 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.595607 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.595709 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.595977 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.596079 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.596236 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.596338 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.596552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.596660 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.596869 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.596971 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.597184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.597295 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.597508 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.597642 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.597837 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.597941 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.598194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.598296 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.598524 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.598658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.598850 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.598953 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.599173 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.599275 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.599490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.599608 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.599805 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.599902 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.600121 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.600223 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.600436 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.600538 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.600758 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.600860 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.601017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 10:50:54.601644 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.601924 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.602262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.602696 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.603018 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.603347 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.603677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.603994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.604323 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.604654 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.605009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.605342 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.605663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.606148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.606505 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.606845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.607180 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.607563 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.607811 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.608126 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.608444 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.608771 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.609102 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.609402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.609713 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.610052 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.610367 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.610680 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.610992 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.611303 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.611619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.611929 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.612239 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.612550 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.612862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.613202 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.613513 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.613829 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.614165 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.614476 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.614792 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.615105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.615413 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.615751 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.616091 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.616415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.616793 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.617642 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.617997 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.618307 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.618637 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.618970 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.619309 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.619608 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.619949 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.620268 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.620586 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.620903 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.621221 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.621538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.621855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.622231 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.622565 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.622879 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.623213 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.623540 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.623871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.624197 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.624517 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.624860 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.625179 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.625498 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.625823 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.626173 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.626497 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.626862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.627148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.627485 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.627823 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.628142 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.628478 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.628846 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.629171 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.629493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.629846 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.630211 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.630536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.630859 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.631175 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 10:50:54.631425 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 10:50:54.660799 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO dbcounter [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Registered counter for database nova_api May 23 10:50:54.681825 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_db.sqlalchemy.engines [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:50:54.689286 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writer thread running {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:50:54.691059 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO dbcounter [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Registered counter for database nova_api May 23 10:50:54.710695 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_db.sqlalchemy.engines [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:50:54.718171 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writer thread running {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:50:54.746471 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.context [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a0b5a72-be8f-4ccc-a37a-e387d6681f68(cell1) {{(pid=129030) load_cells /opt/stack/nova/nova/context.py:464}} May 23 10:50:54.750658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:50:54.752288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:50:54.753100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:50:54.755156 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:50:54.757113 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO dbcounter [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Registered counter for database nova_cell0 May 23 10:50:54.761153 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO dbcounter [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Registered counter for database nova_cell1 May 23 10:50:54.768891 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_db.sqlalchemy.engines [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:50:54.770985 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_db.sqlalchemy.engines [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:50:54.775728 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.context [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a0b5a72-be8f-4ccc-a37a-e387d6681f68(cell1) {{(pid=129029) load_cells /opt/stack/nova/nova/context.py:464}} May 23 10:50:54.777094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writer thread running {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:50:54.779226 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writer thread running {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:50:54.779937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:50:54.781560 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:50:54.782402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:50:54.784426 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:50:54.786411 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO dbcounter [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Registered counter for database nova_cell0 May 23 10:50:54.791152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO dbcounter [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Registered counter for database nova_cell1 May 23 10:50:54.799175 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_db.sqlalchemy.engines [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:50:54.799912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_db.sqlalchemy.engines [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:50:54.806041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writer thread running {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:50:54.808683 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writer thread running {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:50:54.926832 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO dbcounter [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Registered counter for database nova_cell0 May 23 10:50:54.933373 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_db.sqlalchemy.engines [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:50:54.938113 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writer thread running {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:50:54.954731 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO dbcounter [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Registered counter for database nova_cell0 May 23 10:50:54.961890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_db.sqlalchemy.engines [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 10:50:54.966324 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writer thread running {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 10:50:55.258566 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: WARNING keystonemiddleware.auth_token [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 10:50:55.265848 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: WARNING keystonemiddleware.auth_token [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 10:50:55.291064 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: WARNING keystonemiddleware.auth_token [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 10:50:55.298981 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: WARNING keystonemiddleware.auth_token [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 10:50:55.611481 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: WARNING keystonemiddleware.auth_token [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 10:50:55.617534 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: WARNING keystonemiddleware.auth_token [None req-d4241591-c02b-4fc2-8411-15b8ba7d8e49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 10:50:55.622889 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562460a1c9c0 pid: 129030 (default app) May 23 10:50:55.652184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: WARNING keystonemiddleware.auth_token [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 10:50:55.658261 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: WARNING keystonemiddleware.auth_token [None req-debd0e6f-b3d0-4a3b-9418-d4911ad68c2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 10:50:55.663622 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562460a1c9c0 pid: 129029 (default app) May 23 10:51:35.679442 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:51:35.680874 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:51:35.682294 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:51:35.683001 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:51:36.705905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-47f893ac-36bb-4297-be31-8d7929921863 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Action: 'create', calling method: .version_select at 0x7fe721983c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1179803358"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:51:37.157439 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=3 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:51:37.159823 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=3 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:51:37.161441 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=3 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:51:37.163514 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=3 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:51:38.446753 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a8f03a9a-33e5-48cc-917d-ff967db3b8b5 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Action: 'create', calling method: .version_select at 0x7fe721984c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1799467252", "metadata": {"Type": "work"}}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:51:38.653832 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-47f893ac-36bb-4297-be31-8d7929921863 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.981503 May 23 10:51:38.656882 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1154 bytes} [Mon May 23 10:51:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2987 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 10:51:38.934653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-540514996", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "networks": [{"uuid": "92fea301-7ecc-4091-83eb-b034e7a94a83"}]}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:51:39.101112 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.network.neutron [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] validate_networks() for [('92fea301-7ecc-4091-83eb-b034e7a94a83', None, None, None, None, None)] {{(pid=129030) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:51:39.595112 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a8f03a9a-33e5-48cc-917d-ff967db3b8b5 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.448936 May 23 10:51:39.596581 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1155 bytes} [Mon May 23 10:51:37 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2452 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 10:51:39.602843 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8359ed3e-9a5d-4b4c-97f9-2167179f1fcd tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe7217d3c10>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:39.694918 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-8359ed3e-9a5d-4b4c-97f9-2167179f1fcd tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203" status: 200 len: 345 microversion: 2.1 time: 0.096519 May 23 10:51:39.701449 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:39 2022] GET /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:39.706883 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5b1f4d15-9f06-4bfb-a70d-9a6567a82d85 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe7217d3dc0>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:39.796584 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5b1f4d15-9f06-4bfb-a70d-9a6567a82d85 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 200 len: 353 microversion: 2.1 time: 0.093464 May 23 10:51:39.797181 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 3/4] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:39 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:40.644305 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cb71833c-ce46-4e7c-a909-6866d11f1a4d tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe7217e7430>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:40.661130 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Flavor limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:51:40.662284 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Image limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:51:40.662979 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Flavor pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:51:40.663558 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Image pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:51:40.664153 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:51:40.692841 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:40.694159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:40.695231 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:40.695855 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:40.755076 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-cb71833c-ce46-4e7c-a909-6866d11f1a4d tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/34367d2e-9827-4125-aa1b-a53e653f795b" status: 200 len: 349 microversion: 2.1 time: 0.115381 May 23 10:51:40.757133 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 4/5] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:40 2022] GET /compute/v2.1/os-volumes/34367d2e-9827-4125-aa1b-a53e653f795b => generated 349 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:40.761938 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ad1109f4-9845-4542-b21b-d7b1d5336552 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe7217e7b80>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:40.765831 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Getting quotas for project e1d35cdfa73449c2bd040f966d9f27a2. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:51:40.784899 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Getting quotas for user 4b61e9897f8e4c8ab2fd8cd6b5244ca5 and project e1d35cdfa73449c2bd040f966d9f27a2. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:51:40.808221 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Going to run 1 instances... {{(pid=129030) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:51:40.811500 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:51:40.979665 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ba3d11da-b220-43b5-b6bf-c5e1f9fa2e17 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.319958 May 23 10:51:40.980347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 2/6] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:51:40.988017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e23873b2-4559-481f-a58a-97c045cf9d02 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe720eeb700>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:41.470723 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ad1109f4-9845-4542-b21b-d7b1d5336552 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203" status: 200 len: 346 microversion: 2.1 time: 0.712444 May 23 10:51:41.471568 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 5/7] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:40 2022] GET /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203 => generated 346 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:41.477408 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c72f719a-3e31-4dd4-b1e5-0fb53769c8aa tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:41.478400 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c72f719a-3e31-4dd4-b1e5-0fb53769c8aa tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:41.565397 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e23873b2-4559-481f-a58a-97c045cf9d02 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 200 len: 354 microversion: 2.1 time: 0.583013 May 23 10:51:41.566297 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 3/8] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:40 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 354 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:41.571484 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9b72febb-cf87-4cbc-932e-a702b64b3504 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Action: 'create', calling method: .version_select at 0x7fe720eeb820>, body: {"snapshot": {"volume_id": "211fbd60-2162-4e8c-afee-4ee60f235203", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1447320611"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:51:41.768650 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c72f719a-3e31-4dd4-b1e5-0fb53769c8aa tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:41.794648 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c72f719a-3e31-4dd4-b1e5-0fb53769c8aa tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1214 microversion: 2.1 time: 0.321125 May 23 10:51:41.796774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 6/9] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:41 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1214 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:41.813448 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-403443dc-9c72-4d1e-835c-a81dce487856 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe72178c670>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:41.953586 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-403443dc-9c72-4d1e-835c-a81dce487856 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 200 len: 354 microversion: 2.1 time: 0.155111 May 23 10:51:41.954246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 7/10] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:41 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:41.989253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e1838028-e1aa-4e58-83d2-bf6696d12116 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe7217ac9d0>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:42.090861 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9b72febb-cf87-4cbc-932e-a702b64b3504 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.522815 May 23 10:51:42.092919 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 4/11] 10.222.0.36 () {60 vars in 1161 bytes} [Mon May 23 10:51:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:42.104686 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-905aed92-a4d5-4db8-91c0-ec0fc7647998 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe7206850d0>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:42.184097 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e1838028-e1aa-4e58-83d2-bf6696d12116 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 202 len: 0 microversion: 2.1 time: 0.211421 May 23 10:51:42.184886 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 8/12] 10.222.0.36 () {58 vars in 1247 bytes} [Mon May 23 10:51:41 2022] DELETE /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:51:42.193718 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-905aed92-a4d5-4db8-91c0-ec0fc7647998 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 200 len: 287 microversion: 2.1 time: 0.094163 May 23 10:51:42.194333 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 5/13] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 10:51:42 2022] GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:42.200897 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-db252833-f5a9-4b81-bd95-db30dbb88edd tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe7217b6040>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:42.207224 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a9d683d0-3af4-4a52-aca0-5d08dc306244 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe720685790>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:42.330867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a9d683d0-3af4-4a52-aca0-5d08dc306244 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.127675 May 23 10:51:42.338260 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 6/14] 10.222.0.36 () {58 vars in 1139 bytes} [Mon May 23 10:51:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:42.344377 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9a264b16-6183-4def-bae4-260f2840180e tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe720685940>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:42.350951 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-db252833-f5a9-4b81-bd95-db30dbb88edd tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 200 len: 353 microversion: 2.1 time: 0.159747 May 23 10:51:42.352093 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 9/15] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:42 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 353 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:42.391322 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9a264b16-6183-4def-bae4-260f2840180e tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 200 len: 287 microversion: 2.1 time: 0.051582 May 23 10:51:42.392281 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 7/16] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 10:51:42 2022] GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:42.808404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b042227d-8c84-45bd-868a-95e3c7529794 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe7217acaf0>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:42.816906 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f26bfe94-3b83-4644-b7e7-7a7bbeb3781a tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:42.817874 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f26bfe94-3b83-4644-b7e7-7a7bbeb3781a tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:43.011210 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b042227d-8c84-45bd-868a-95e3c7529794 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f352af49-70ba-4bb7-82b9-cd77face76d4" status: 200 len: 350 microversion: 2.1 time: 0.206993 May 23 10:51:43.012065 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 10/17] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:42 2022] GET /compute/v2.1/os-volumes/f352af49-70ba-4bb7-82b9-cd77face76d4 => generated 350 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:43.178441 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f26bfe94-3b83-4644-b7e7-7a7bbeb3781a tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:43.202845 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f26bfe94-3b83-4644-b7e7-7a7bbeb3781a tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1214 microversion: 2.1 time: 0.389771 May 23 10:51:43.212841 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 8/18] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:42 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1214 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:51:43.364368 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e3b27d63-6d36-4a79-a29a-80c9e1b63d07 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe72178c310>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:43.404585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-cc9b210d-ca47-40a8-a934-55fa71471482 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe720685940>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:43.505067 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-cc9b210d-ca47-40a8-a934-55fa71471482 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 200 len: 287 microversion: 2.1 time: 0.105571 May 23 10:51:43.506756 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 9/19] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 10:51:43 2022] GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:43.519589 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e3b27d63-6d36-4a79-a29a-80c9e1b63d07 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 200 len: 353 microversion: 2.1 time: 0.159518 May 23 10:51:43.520671 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 11/20] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:43 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 353 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:44.229801 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2dd3e088-8388-4922-bed7-9c2f28e53177 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:44.231087 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2dd3e088-8388-4922-bed7-9c2f28e53177 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:44.240790 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2dd3e088-8388-4922-bed7-9c2f28e53177 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:44.243755 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2dd3e088-8388-4922-bed7-9c2f28e53177 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:44.248523 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2dd3e088-8388-4922-bed7-9c2f28e53177 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:44.251745 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2dd3e088-8388-4922-bed7-9c2f28e53177 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:44.517147 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-703497a5-c0db-4868-a7b0-ae2038da497b tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe7217b63a0>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:44.572225 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-703497a5-c0db-4868-a7b0-ae2038da497b tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 200 len: 287 microversion: 2.1 time: 0.059210 May 23 10:51:44.573294 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 12/21] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 10:51:44 2022] GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:44.580047 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-231c2645-d0ab-4363-b1c7-79903572fdea tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe721869550>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:44.678412 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-231c2645-d0ab-4363-b1c7-79903572fdea tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 200 len: 353 microversion: 2.1 time: 0.102963 May 23 10:51:44.679038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 13/22] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:44 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:44.709743 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2dd3e088-8388-4922-bed7-9c2f28e53177 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:44.735860 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2dd3e088-8388-4922-bed7-9c2f28e53177 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1218 microversion: 2.1 time: 0.510844 May 23 10:51:44.736462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 10/23] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:44 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1218 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:45.585327 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0ae288f9-5f86-49b3-ac10-071158bf7cf4 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe7217ac8b0>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:45.642862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-0ae288f9-5f86-49b3-ac10-071158bf7cf4 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 200 len: 287 microversion: 2.1 time: 0.062826 May 23 10:51:45.643447 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 14/24] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 10:51:45 2022] GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:45.691460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2516d602-2611-4d67-8756-7d84cb5fd622 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe720628790>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:45.756329 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-7ddddbf0-9c31-40c0-982a-f39362dfcb81 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:45.757372 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-7ddddbf0-9c31-40c0-982a-f39362dfcb81 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:45.770680 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7ddddbf0-9c31-40c0-982a-f39362dfcb81 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:45.772701 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7ddddbf0-9c31-40c0-982a-f39362dfcb81 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:45.775729 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7ddddbf0-9c31-40c0-982a-f39362dfcb81 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:45.776397 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7ddddbf0-9c31-40c0-982a-f39362dfcb81 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:45.807587 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2516d602-2611-4d67-8756-7d84cb5fd622 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 200 len: 353 microversion: 2.1 time: 0.120045 May 23 10:51:45.808548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 11/25] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:45 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:46.097415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-7ddddbf0-9c31-40c0-982a-f39362dfcb81 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:46.113777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-7ddddbf0-9c31-40c0-982a-f39362dfcb81 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1210 microversion: 2.1 time: 0.364541 May 23 10:51:46.120872 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 15/26] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:45 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1210 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:46.656903 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b1735c94-4fa5-4575-9d50-4f8545d537b0 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe72063c4c0>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:46.733109 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b1735c94-4fa5-4575-9d50-4f8545d537b0 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 200 len: 288 microversion: 2.1 time: 0.081077 May 23 10:51:46.734690 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 12/27] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 10:51:46 2022] GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:46.749318 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d8463ee9-e0d2-4b01-94cb-e92725a6fc9e tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe721742160>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:46.826607 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9f7a7e94-f934-4bb0-88fe-ba1fa9d09ac8 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe720628940>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:46.884968 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d8463ee9-e0d2-4b01-94cb-e92725a6fc9e tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 202 len: 0 microversion: 2.1 time: 0.142235 May 23 10:51:46.886079 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 16/28] 10.222.0.36 () {58 vars in 1253 bytes} [Mon May 23 10:51:46 2022] DELETE /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:51:46.898886 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9f7a7e94-f934-4bb0-88fe-ba1fa9d09ac8 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 200 len: 353 microversion: 2.1 time: 0.081531 May 23 10:51:46.903659 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 13/29] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:46 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:46.908494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3cce48d6-8ec8-4fcb-96f6-d82b6682efdd tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe720610ee0>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:47.011706 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-dd4c3284-dc66-4e22-84d3-7ebf5f7b079e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'create', calling method: .version_select at 0x7fe721742550>, body: {"keypair": {"name": "tempest-keypair-609502394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKrVH5oGtfKdjHdhXaNpwvFQSaB3SoxS9sbUudj/G1gtAtqkDnXbhCT8hSMYRY0Zkukvz/nxcgWMFaUnUrdee94XxAsK67YZ7EVAXltthLpuuv0kGhG54u8NCMYttBZQg=="}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:51:47.031839 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3cce48d6-8ec8-4fcb-96f6-d82b6682efdd tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 200 len: 287 microversion: 2.1 time: 0.131084 May 23 10:51:47.032707 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 14/30] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 10:51:46 2022] GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:47.095451 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-dd4c3284-dc66-4e22-84d3-7ebf5f7b079e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Getting quotas for project 3d45f08040d949bd8949e3d1faab25c4. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:51:47.118212 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-dd4c3284-dc66-4e22-84d3-7ebf5f7b079e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Getting quotas for user a1fc33c4ee0c4b30a862f6685817bdf4 and project 3d45f08040d949bd8949e3d1faab25c4. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:51:47.137821 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-cea48099-4bd6-47cc-9a02-6c7a1c6a1803 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:47.138738 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-cea48099-4bd6-47cc-9a02-6c7a1c6a1803 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:47.149213 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cea48099-4bd6-47cc-9a02-6c7a1c6a1803 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:47.154602 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cea48099-4bd6-47cc-9a02-6c7a1c6a1803 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:47.155935 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cea48099-4bd6-47cc-9a02-6c7a1c6a1803 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:47.156525 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cea48099-4bd6-47cc-9a02-6c7a1c6a1803 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:47.229022 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-dd4c3284-dc66-4e22-84d3-7ebf5f7b079e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.337542 May 23 10:51:47.230033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 17/31] 10.222.0.36 () {60 vars in 1158 bytes} [Mon May 23 10:51:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:47.467350 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-cea48099-4bd6-47cc-9a02-6c7a1c6a1803 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:47.480085 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-cea48099-4bd6-47cc-9a02-6c7a1c6a1803 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1266 microversion: 2.1 time: 0.346643 May 23 10:51:47.484924 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 15/32] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:47 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:47.911317 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1a407a6f-1773-457a-b427-008ad43e4530 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe721678430>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:47.987428 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1a407a6f-1773-457a-b427-008ad43e4530 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 200 len: 353 microversion: 2.1 time: 0.079840 May 23 10:51:47.991240 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 18/33] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:47 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:48.045490 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-032d8304-a3ea-4c9d-a749-7b512bad7982 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe7205dc8b0>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:48.102550 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-032d8304-a3ea-4c9d-a749-7b512bad7982 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 200 len: 287 microversion: 2.1 time: 0.061632 May 23 10:51:48.104031 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 16/34] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 10:51:48 2022] GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:48.497091 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a9e2cb83-27ff-473e-a9d8-8f75fd7e6d93 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:48.497714 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a9e2cb83-27ff-473e-a9d8-8f75fd7e6d93 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:48.507127 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9e2cb83-27ff-473e-a9d8-8f75fd7e6d93 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:48.511823 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9e2cb83-27ff-473e-a9d8-8f75fd7e6d93 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:48.512980 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9e2cb83-27ff-473e-a9d8-8f75fd7e6d93 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:48.513600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9e2cb83-27ff-473e-a9d8-8f75fd7e6d93 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:48.698818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a9e2cb83-27ff-473e-a9d8-8f75fd7e6d93 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:48.711410 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a9e2cb83-27ff-473e-a9d8-8f75fd7e6d93 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1266 microversion: 2.1 time: 0.218335 May 23 10:51:48.724026 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 19/35] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:48 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:49.004787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b742a515-a5fb-49ad-92f9-bbbfd1d74d76 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe7205f2af0>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:49.117188 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9207c04e-821e-4b1e-ab51-9ea6427344d9 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe720e10a60>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:49.137600 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b742a515-a5fb-49ad-92f9-bbbfd1d74d76 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 200 len: 353 microversion: 2.1 time: 0.137416 May 23 10:51:49.138518 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 17/36] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:48 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:49.204495 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9207c04e-821e-4b1e-ab51-9ea6427344d9 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 200 len: 287 microversion: 2.1 time: 0.092685 May 23 10:51:49.205762 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 20/37] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 10:51:49 2022] GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:51:49.735899 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6c1462d2-a0b6-4f2e-b13b-3ac618d84503 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:49.736610 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6c1462d2-a0b6-4f2e-b13b-3ac618d84503 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:49.754699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6c1462d2-a0b6-4f2e-b13b-3ac618d84503 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:49.758817 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6c1462d2-a0b6-4f2e-b13b-3ac618d84503 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:49.760530 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6c1462d2-a0b6-4f2e-b13b-3ac618d84503 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:49.766409 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6c1462d2-a0b6-4f2e-b13b-3ac618d84503 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:49.952292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6c1462d2-a0b6-4f2e-b13b-3ac618d84503 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:49.974556 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6c1462d2-a0b6-4f2e-b13b-3ac618d84503 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1272 microversion: 2.1 time: 0.247267 May 23 10:51:49.976203 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 18/38] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:49 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:50.155924 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ee7a9753-3ed4-431e-ad0b-671067725a42 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Calling method '.version_select at 0x7fe720e10160>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:50.210890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-ee7a9753-3ed4-431e-ad0b-671067725a42 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] HTTP exception thrown: Volume 937d1e8e-4d5c-406a-a0a8-00255feb45de could not be found. May 23 10:51:50.218044 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e056ec46-675f-42c5-8669-91ce603bdfee tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe7205f2310>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ee7a9753-3ed4-431e-ad0b-671067725a42 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Request method failure captured: May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de HTTP/1.1 May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2c5-z3ox8hKDCP5zCCrhB9tLJWapnx7mxfXCDGCqjkgm5DAp7V2s-aRfbDUZIVWMiTwr2lp4HX9he5jrzdBKpKYGSbd4BbJ35EI-fZ_iZDoTpNBmSWaNOnkN9yubmQq9gQFTgr1_G_pzE9cQ49K_k4rRj5vlh5H9RzP9PTEelbAPk0 May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: bfc709155cdb4a34a24fc5bd463716a5 May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesGetTestJSON-42131768 May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:51:50.228567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfc709155cdb4a34a24fc5bd463716a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfc709155cdb4a34a24fc5bd463716a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfc709155cdb4a34a24fc5bd463716a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfc709155cdb4a34a24fc5bd463716a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesGetTestJSON-42131768 May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: bfc709155cdb4a34a24fc5bd463716a5 May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesGetTestJSON-42131768 May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesGetTestJSON-42131768-project May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: c5a42fb25848435c85ec4c3c73d97b80 May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesGetTestJSON-42131768-project May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Volume 937d1e8e-4d5c-406a-a0a8-00255feb45de could not be found. May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '937d1e8e-4d5c-406a-a0a8-00255feb45de'} May 23 10:51:50.229708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 937d1e8e-4d5c-406a-a0a8-00255feb45de could not be found. (HTTP 404) (Request-ID: req-284f041b-9877-4029-a831-0b945c4cbe74) May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:50.230454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 10:51:50.231469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 937d1e8e-4d5c-406a-a0a8-00255feb45de could not be found. May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 10:51:50.232433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 937d1e8e-4d5c-406a-a0a8-00255feb45de could not be found. May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 937d1e8e-4d5c-406a-a0a8-00255feb45de could not be found. May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:50.233421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ee7a9753-3ed4-431e-ad0b-671067725a42 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] Returning 404 to user: Volume 937d1e8e-4d5c-406a-a0a8-00255feb45de could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:51:50.240648 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ee7a9753-3ed4-431e-ad0b-671067725a42 tempest-VolumesGetTestJSON-42131768 tempest-VolumesGetTestJSON-42131768-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de" status: 404 len: 109 microversion: 2.1 time: 0.082924 May 23 10:51:50.247337 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 21/39] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:50 2022] GET /compute/v2.1/os-volumes/937d1e8e-4d5c-406a-a0a8-00255feb45de => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:51:50.433158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-e056ec46-675f-42c5-8669-91ce603bdfee tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] HTTP exception thrown: Snapshot 6f17cf07-26ca-423c-8c30-725b51e39407 could not be found. May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e056ec46-675f-42c5-8669-91ce603bdfee tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Request method failure captured: May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 HTTP/1.1 May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2c3MBI87fR61cL1HuHl87Y6AfgB1S170FgK5VF55FxuorNZT3umHuhrp9vBZ-4Tlcye0qKsf_sLvB4OGThRd9vaDgjPKPZ2acazR0CNF2RGetKST9jmMBYDoLWK241-O-EwaoN8R6vzr4N6gOMQC9eGNPAxjuT01s0L18BuYyk8anM May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 2707ec87254b4e55b636f5a5ac143858 May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:51:50.437716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2707ec87254b4e55b636f5a5ac143858", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 2707ec87254b4e55b636f5a5ac143858 May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-VolumesSnapshotsTestJSON-991571962-project May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: ba02be702029458c837072cf0490f600 May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-VolumesSnapshotsTestJSON-991571962-project May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Snapshot 6f17cf07-26ca-423c-8c30-725b51e39407 could not be found. May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': '6f17cf07-26ca-423c-8c30-725b51e39407'} May 23 10:51:50.438947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6f17cf07-26ca-423c-8c30-725b51e39407 could not be found. (HTTP 404) (Request-ID: req-1341abbe-5478-47e7-b6b2-adfd1a4c100d) May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:50.439585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 10:51:50.440391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6f17cf07-26ca-423c-8c30-725b51e39407 could not be found. May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 23 10:51:50.441549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6f17cf07-26ca-423c-8c30-725b51e39407 could not be found. May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6f17cf07-26ca-423c-8c30-725b51e39407 could not be found. May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e056ec46-675f-42c5-8669-91ce603bdfee tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Returning 404 to user: Snapshot 6f17cf07-26ca-423c-8c30-725b51e39407 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:51:50.442758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e056ec46-675f-42c5-8669-91ce603bdfee tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407" status: 404 len: 111 microversion: 2.1 time: 0.226918 May 23 10:51:50.444546 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 19/40] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 10:51:50 2022] GET /compute/v2.1/os-snapshots/6f17cf07-26ca-423c-8c30-725b51e39407 => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:51:50.470297 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-313dd2ea-075d-477d-a980-2d516cb58d7c tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe720685e50>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:50.483284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4e489063-b6df-415e-8f91-6fa97bc4a49f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: .version_select at 0x7fe720e17550>, body: {"keypair": {"name": "tempest-keypair-1924477262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA67/yH1X9D1jCzUxGrF3K6jZKLBHWBnqboDOn8gCW0nnJsY/fGPXUzN5EB9VlKBfcjbkJhSRSgbSR/9mV+2JoYY4NTAmryVHMeoBeKDFn8vQ/rIbO1RC5gUqwaPCxYFYg=="}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:51:50.532908 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-4e489063-b6df-415e-8f91-6fa97bc4a49f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:51:50.538086 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-4e489063-b6df-415e-8f91-6fa97bc4a49f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for user 8e98c8ceac6b47079423b45685c5ba3e and project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:51:50.598807 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4e489063-b6df-415e-8f91-6fa97bc4a49f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.257085 May 23 10:51:50.602787 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 22/41] 10.222.0.36 () {60 vars in 1158 bytes} [Mon May 23 10:51:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:51:50.614463 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fe71253b-4d3c-474d-9aa3-0c755e8eabfe tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe720e17a60>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:50.650566 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-313dd2ea-075d-477d-a980-2d516cb58d7c tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fdcdbc01-5f4c-48ce-bb3b-b7910b5a5cbe" status: 200 len: 350 microversion: 2.1 time: 0.202142 May 23 10:51:50.651161 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 20/42] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:50 2022] GET /compute/v2.1/os-volumes/fdcdbc01-5f4c-48ce-bb3b-b7910b5a5cbe => generated 350 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:50.668175 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-74ac87e4-8ff4-487b-ac92-ffcfec1cf42b tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe720600790>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:50.727579 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:51:50.858253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fe71253b-4d3c-474d-9aa3-0c755e8eabfe tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203" status: 202 len: 0 microversion: 2.1 time: 0.254087 May 23 10:51:50.859145 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 23/43] 10.222.0.36 () {58 vars in 1247 bytes} [Mon May 23 10:51:50 2022] DELETE /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:51:50.870304 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4bf53b22-5a41-41a5-8639-03e519504df9 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe7216785e0>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:51.152440 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-74ac87e4-8ff4-487b-ac92-ffcfec1cf42b tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.492221 May 23 10:51:51.162574 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 21/44] 10.222.0.36 () {58 vars in 1133 bytes} [Mon May 23 10:51:50 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:51.253109 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-4bf53b22-5a41-41a5-8639-03e519504df9 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] HTTP exception thrown: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4bf53b22-5a41-41a5-8639-03e519504df9 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Request method failure captured: May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203 HTTP/1.1 May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2c3MBI87fR61cL1HuHl87Y6AfgB1S170FgK5VF55FxuorNZT3umHuhrp9vBZ-4Tlcye0qKsf_sLvB4OGThRd9vaDgjPKPZ2acazR0CNF2RGetKST9jmMBYDoLWK241-O-EwaoN8R6vzr4N6gOMQC9eGNPAxjuT01s0L18BuYyk8anM May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 2707ec87254b4e55b636f5a5ac143858 May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:51:51.257777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2707ec87254b4e55b636f5a5ac143858", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 2707ec87254b4e55b636f5a5ac143858 May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesSnapshotsTestJSON-991571962-project May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: ba02be702029458c837072cf0490f600 May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesSnapshotsTestJSON-991571962-project May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '211fbd60-2162-4e8c-afee-4ee60f235203'} May 23 10:51:51.258935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. (HTTP 404) (Request-ID: req-b23417db-96b3-4306-b0c0-4d2db08cc2aa) May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:51.259646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 10:51:51.260610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 10:51:51.261564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:51.262670 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:51.265455 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4bf53b22-5a41-41a5-8639-03e519504df9 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Returning 404 to user: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:51:51.266478 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4bf53b22-5a41-41a5-8639-03e519504df9 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203" status: 404 len: 109 microversion: 2.1 time: 0.402554 May 23 10:51:51.278940 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 24/45] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:50 2022] GET /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203 => generated 109 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:51:51.292077 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-90f3c3ce-914a-45e0-8474-0141c2f0e2ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:51.297179 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-90f3c3ce-914a-45e0-8474-0141c2f0e2ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:51.330557 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-90f3c3ce-914a-45e0-8474-0141c2f0e2ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:51.331008 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-90f3c3ce-914a-45e0-8474-0141c2f0e2ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:51.331930 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-90f3c3ce-914a-45e0-8474-0141c2f0e2ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:51.332380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-90f3c3ce-914a-45e0-8474-0141c2f0e2ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:51.625352 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-90f3c3ce-914a-45e0-8474-0141c2f0e2ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:51.634322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-90f3c3ce-914a-45e0-8474-0141c2f0e2ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1272 microversion: 2.1 time: 0.354044 May 23 10:51:51.646065 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 25/46] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:51 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1272 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:51.653697 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4d159cd6-609f-4d47-923a-c47c6bac5a67 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe720e17e50>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:51.943993 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6b9b439e-c854-4b1c-b80d-e323bbadd074 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Action: 'create', calling method: .version_select at 0x7fe7205dc820>, body: {"keypair": {"name": "tempest-keypair-766572678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEWn/53eG97weiJO1ZeuDpEs/cyrMQ/65OFsjwC9WkH60mhhiiqE3Cu4RDlHVBAC/kiZTrTWdAg/Y6XKnncfG0gDeyqdvUQTJLjjHKq34rT0XbgO5kub2ml6AnNxUHnog=="}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:51:51.982876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4d159cd6-609f-4d47-923a-c47c6bac5a67 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.335540 May 23 10:51:51.983420 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 26/47] 10.222.0.36 () {58 vars in 1148 bytes} [Mon May 23 10:51:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:52.002859 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fa616fa5-9111-4fa4-8a17-20f0974f527f tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe7216bfc10>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:52.040730 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-6b9b439e-c854-4b1c-b80d-e323bbadd074 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Getting quotas for project 2c669b26bf1845a6a3b35eb551ebcb98. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:51:52.058105 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-6b9b439e-c854-4b1c-b80d-e323bbadd074 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Getting quotas for user 7433cc7ed66f4e609332c56c936487e8 and project 2c669b26bf1845a6a3b35eb551ebcb98. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:51:52.091683 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-fa616fa5-9111-4fa4-8a17-20f0974f527f tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] HTTP exception thrown: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fa616fa5-9111-4fa4-8a17-20f0974f527f tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Request method failure captured: May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203 HTTP/1.1 May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2c3MBI87fR61cL1HuHl87Y6AfgB1S170FgK5VF55FxuorNZT3umHuhrp9vBZ-4Tlcye0qKsf_sLvB4OGThRd9vaDgjPKPZ2acazR0CNF2RGetKST9jmMBYDoLWK241-O-EwaoN8R6vzr4N6gOMQC9eGNPAxjuT01s0L18BuYyk8anM May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 2707ec87254b4e55b636f5a5ac143858 May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:51:52.094033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2707ec87254b4e55b636f5a5ac143858", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 2707ec87254b4e55b636f5a5ac143858 May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesSnapshotsTestJSON-991571962-project May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: ba02be702029458c837072cf0490f600 May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesSnapshotsTestJSON-991571962-project May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '211fbd60-2162-4e8c-afee-4ee60f235203'} May 23 10:51:52.095600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. (HTTP 404) (Request-ID: req-325399ca-d8cf-47be-924c-9d54f769a8a5) May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:52.096418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 10:51:52.097613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 10:51:52.099954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fa616fa5-9111-4fa4-8a17-20f0974f527f tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Returning 404 to user: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:51:52.102585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fa616fa5-9111-4fa4-8a17-20f0974f527f tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203" status: 404 len: 109 microversion: 2.1 time: 0.110165 May 23 10:51:52.104449 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 27/48] 10.222.0.36 () {58 vars in 1247 bytes} [Mon May 23 10:51:51 2022] DELETE /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:51:52.120225 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-db463806-1e44-4a29-8a63-db0eb7e92e60 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe721727d30>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:52.222851 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6b9b439e-c854-4b1c-b80d-e323bbadd074 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.058702 May 23 10:51:52.226705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 22/49] 10.222.0.36 () {62 vars in 1199 bytes} [Mon May 23 10:51:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1063 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 10:51:52.268063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-13244788-9f83-4983-ae71-bf14fdb313f8 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Calling method '.version_select at 0x7fe7205f2d30>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:52.451618 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-db463806-1e44-4a29-8a63-db0eb7e92e60 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.346725 May 23 10:51:52.452166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 28/50] 10.222.0.36 () {58 vars in 1133 bytes} [Mon May 23 10:51:52 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:52.466359 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6b603e06-c0de-4179-8ac0-fbc3ef135668 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe7217b6040>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:52.544320 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-13244788-9f83-4983-ae71-bf14fdb313f8 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] HTTP exception thrown: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-13244788-9f83-4983-ae71-bf14fdb313f8 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Request method failure captured: May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203 HTTP/1.1 May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2c3MBI87fR61cL1HuHl87Y6AfgB1S170FgK5VF55FxuorNZT3umHuhrp9vBZ-4Tlcye0qKsf_sLvB4OGThRd9vaDgjPKPZ2acazR0CNF2RGetKST9jmMBYDoLWK241-O-EwaoN8R6vzr4N6gOMQC9eGNPAxjuT01s0L18BuYyk8anM May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 2707ec87254b4e55b636f5a5ac143858 May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:51:52.547528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2707ec87254b4e55b636f5a5ac143858", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2707ec87254b4e55b636f5a5ac143858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 2707ec87254b4e55b636f5a5ac143858 May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-991571962 May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-VolumesSnapshotsTestJSON-991571962-project May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: ba02be702029458c837072cf0490f600 May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-VolumesSnapshotsTestJSON-991571962-project May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': '211fbd60-2162-4e8c-afee-4ee60f235203'} May 23 10:51:52.548540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. (HTTP 404) (Request-ID: req-9a102c31-4895-4b02-9e57-fa7a0457380a) May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:52.549164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 10:51:52.550077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 10:51:52.550940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-13244788-9f83-4983-ae71-bf14fdb313f8 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] Returning 404 to user: Volume 211fbd60-2162-4e8c-afee-4ee60f235203 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:51:52.551812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-13244788-9f83-4983-ae71-bf14fdb313f8 tempest-VolumesSnapshotsTestJSON-991571962 tempest-VolumesSnapshotsTestJSON-991571962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203" status: 404 len: 109 microversion: 2.1 time: 0.323094 May 23 10:51:52.554790 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 23/51] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:51:52 2022] GET /compute/v2.1/os-volumes/211fbd60-2162-4e8c-afee-4ee60f235203 => generated 109 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:51:52.657705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b31fa954-bb3d-4c8f-93d5-b81774c1cd13 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:52.658837 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b31fa954-bb3d-4c8f-93d5-b81774c1cd13 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:52.681423 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b31fa954-bb3d-4c8f-93d5-b81774c1cd13 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:52.682949 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b31fa954-bb3d-4c8f-93d5-b81774c1cd13 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:52.687874 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b31fa954-bb3d-4c8f-93d5-b81774c1cd13 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:52.689051 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b31fa954-bb3d-4c8f-93d5-b81774c1cd13 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:52.734152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6b603e06-c0de-4179-8ac0-fbc3ef135668 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.272442 May 23 10:51:52.735053 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 29/52] 10.222.0.36 () {58 vars in 1166 bytes} [Mon May 23 10:51:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:52.750823 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-aaa25f00-6627-4e84-84d8-f9f170dcbef5 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe720e03e50>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:53.150038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-aaa25f00-6627-4e84-84d8-f9f170dcbef5 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.404201 May 23 10:51:53.151366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 30/53] 10.222.0.36 () {58 vars in 1169 bytes} [Mon May 23 10:51:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:53.193981 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3068e361-1205-4f1e-9e01-4da2c41a11da tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe720e03af0>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:53.571731 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3068e361-1205-4f1e-9e01-4da2c41a11da tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.409036 May 23 10:51:53.572355 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 31/54] 10.222.0.36 () {58 vars in 1154 bytes} [Mon May 23 10:51:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:53.602941 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-922161211", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe3ed0a0-128b-4371-b1e9-f319ad129eb5"}], "security_groups": [{"name": "tempest-securitygroup--1179968844"}], "key_name": "tempest-keypair-609502394", "user_data": "}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:51:53.907206 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b31fa954-bb3d-4c8f-93d5-b81774c1cd13 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:53.915015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b31fa954-bb3d-4c8f-93d5-b81774c1cd13 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 1.262125 May 23 10:51:53.915598 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 24/55] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:52 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:53.941833 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-69a1eef1-d470-4000-a290-3d2e06e251b1 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe720eeb430>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:54.226834 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-69a1eef1-d470-4000-a290-3d2e06e251b1 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.295499 May 23 10:51:54.227511 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 25/56] 10.222.0.36 () {58 vars in 1187 bytes} [Mon May 23 10:51:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:51:54.244080 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c769832f-9c1a-424b-8f9c-2dff42c3fe35 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] Calling method '.version_select at 0x7fe720623790>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:54.523324 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] validate_networks() for [('fe3ed0a0-128b-4371-b1e9-f319ad129eb5', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:51:54.563393 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c769832f-9c1a-424b-8f9c-2dff42c3fe35 tempest-VolumesTestJSON-766790054 tempest-VolumesTestJSON-766790054-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.327353 May 23 10:51:54.564561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 26/57] 10.222.0.36 () {58 vars in 1154 bytes} [Mon May 23 10:51:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:54.934073 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1ef507fb-4f24-47e2-a591-b606d2aecc75 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:54.934073 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1ef507fb-4f24-47e2-a591-b606d2aecc75 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:54.946268 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ef507fb-4f24-47e2-a591-b606d2aecc75 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:54.946729 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ef507fb-4f24-47e2-a591-b606d2aecc75 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:54.952368 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ef507fb-4f24-47e2-a591-b606d2aecc75 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:54.953322 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ef507fb-4f24-47e2-a591-b606d2aecc75 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:55.839873 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1ef507fb-4f24-47e2-a591-b606d2aecc75 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:55.855401 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1ef507fb-4f24-47e2-a591-b606d2aecc75 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.927029 May 23 10:51:55.882525 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 27/58] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:54 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:56.891071 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2c708601-bf34-40e6-bad1-936ca46d3662 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:56.891703 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2c708601-bf34-40e6-bad1-936ca46d3662 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:56.908157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2c708601-bf34-40e6-bad1-936ca46d3662 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:56.908708 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2c708601-bf34-40e6-bad1-936ca46d3662 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:56.916277 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2c708601-bf34-40e6-bad1-936ca46d3662 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:56.916828 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2c708601-bf34-40e6-bad1-936ca46d3662 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:57.433275 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2c708601-bf34-40e6-bad1-936ca46d3662 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:51:57.453357 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2c708601-bf34-40e6-bad1-936ca46d3662 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.567140 May 23 10:51:57.455203 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 28/59] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:56 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:51:58.042452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-310556981", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d9bbc8d-a3c4-4810-9114-b7a4b20eeef1"}], "security_groups": [{"name": "tempest-securitygroup--13735236"}], "key_name": "tempest-keypair-766572678", "user_data": "}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:51:58.401110 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.network.neutron [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] validate_networks() for [('9d9bbc8d-a3c4-4810-9114-b7a4b20eeef1', None, None, None, None, None)] {{(pid=129030) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:51:59.362698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:51:59.363160 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:51:59.363732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:51:59.366802 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:51:59.367390 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:51:59.379412 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Flavor limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:51:59.380636 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Image limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:51:59.381257 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Flavor pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:51:59.381840 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Image pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:51:59.382766 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:51:59.409158 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:59.413584 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:59.414730 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:59.415796 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:59.416396 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:59.416980 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:59.418804 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:59.421671 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:59.561397 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Getting quotas for project 2c669b26bf1845a6a3b35eb551ebcb98. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:51:59.571986 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Getting quotas for user 7433cc7ed66f4e609332c56c936487e8 and project 2c669b26bf1845a6a3b35eb551ebcb98. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:51:59.574489 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Getting quotas for project 3d45f08040d949bd8949e3d1faab25c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:51:59.593251 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Getting quotas for user a1fc33c4ee0c4b30a862f6685817bdf4 and project 3d45f08040d949bd8949e3d1faab25c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:51:59.637379 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Going to run 1 instances... {{(pid=129030) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:51:59.647897 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:51:59.666852 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:51:59.700545 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:51:59.884522 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-87dbe624-c9a1-4d90-9171-2e189ea86434 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.850058 May 23 10:51:59.896867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 29/60] 10.222.0.36 () {62 vars in 1187 bytes} [Mon May 23 10:51:58 2022] POST /compute/v2.1/servers => generated 400 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 10:51:59.921538 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-69d234ac-4e36-4627-9dde-226d0c49ec02 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:51:59.924438 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-69d234ac-4e36-4627-9dde-226d0c49ec02 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:51:59.938571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-69d234ac-4e36-4627-9dde-226d0c49ec02 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:59.939156 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-69d234ac-4e36-4627-9dde-226d0c49ec02 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:51:59.940770 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-69d234ac-4e36-4627-9dde-226d0c49ec02 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:51:59.942566 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-69d234ac-4e36-4627-9dde-226d0c49ec02 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:00.000607 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-595b8f60-430d-4bd2-9e2b-8f9ea332db15 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.408486 May 23 10:52:00.001632 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 32/61] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:51:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 6429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:52:00.017773 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-07eea9ce-d975-41da-975b-2e1b3f919a1a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:00.048489 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-07eea9ce-d975-41da-975b-2e1b3f919a1a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:00.393620 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-69d234ac-4e36-4627-9dde-226d0c49ec02 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:00.403945 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-69d234ac-4e36-4627-9dde-226d0c49ec02 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.501653 May 23 10:52:00.413762 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 30/62] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:51:59 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:00.426172 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-993a485b-ac7a-45e7-8a7e-abfc0cc71827 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:00.427160 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-993a485b-ac7a-45e7-8a7e-abfc0cc71827 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:00.575531 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-993a485b-ac7a-45e7-8a7e-abfc0cc71827 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:00.587849 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-993a485b-ac7a-45e7-8a7e-abfc0cc71827 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1236 microversion: 2.1 time: 0.170456 May 23 10:52:00.590267 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 31/63] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:00 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1236 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:00.850734 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-07eea9ce-d975-41da-975b-2e1b3f919a1a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:00.865873 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-07eea9ce-d975-41da-975b-2e1b3f919a1a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:00.876887 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-07eea9ce-d975-41da-975b-2e1b3f919a1a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:00.882212 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-07eea9ce-d975-41da-975b-2e1b3f919a1a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1280 microversion: 2.20 time: 0.877077 May 23 10:52:00.889250 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:00 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1280 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:01.431304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-34a17ec9-6a5b-42ae-af76-f7989faa49c5 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:01.431979 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-34a17ec9-6a5b-42ae-af76-f7989faa49c5 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:01.449564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34a17ec9-6a5b-42ae-af76-f7989faa49c5 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:01.450068 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34a17ec9-6a5b-42ae-af76-f7989faa49c5 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:01.458867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34a17ec9-6a5b-42ae-af76-f7989faa49c5 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:01.464741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34a17ec9-6a5b-42ae-af76-f7989faa49c5 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:01.606227 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ec7ef31a-bfaa-4aab-9cd6-f10a136f91a1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:01.606853 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ec7ef31a-bfaa-4aab-9cd6-f10a136f91a1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:02.058542 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ec7ef31a-bfaa-4aab-9cd6-f10a136f91a1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:02.076918 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ec7ef31a-bfaa-4aab-9cd6-f10a136f91a1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1236 microversion: 2.1 time: 0.472884 May 23 10:52:02.082257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 34/65] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:01 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1236 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:52:02.125885 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-33952bb0-1c2b-4e4e-8949-dd0c999e6f32 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:02.132946 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-33952bb0-1c2b-4e4e-8949-dd0c999e6f32 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:02.444197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-34a17ec9-6a5b-42ae-af76-f7989faa49c5 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:02.470411 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-34a17ec9-6a5b-42ae-af76-f7989faa49c5 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 1.042786 May 23 10:52:02.477729 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 32/66] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:01 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:03.204546 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-33952bb0-1c2b-4e4e-8949-dd0c999e6f32 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:03.218182 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-33952bb0-1c2b-4e4e-8949-dd0c999e6f32 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:03.226742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-33952bb0-1c2b-4e4e-8949-dd0c999e6f32 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:03.228903 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-33952bb0-1c2b-4e4e-8949-dd0c999e6f32 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1280 microversion: 2.20 time: 1.134048 May 23 10:52:03.266044 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 35/67] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:02 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1280 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:03.291188 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1163074267", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6500cd5-4edf-47aa-9e35-9691dad60917"}], "security_groups": [{"name": "tempest-securitygroup--1492201798"}], "key_name": "tempest-keypair-1924477262", "user_data": "}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:03.554558 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-b583f4da-b619-47c5-b62b-74855ec9bc52 req-d60b9f7d-9410-4c74-b984-1f338811166d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a4d1f8-ff32-41e3-93ec-425c2fbabedb", "tag": "43edbf74-9e3b-4e8e-9196-d531a42a98a9"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:03.585334 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-b583f4da-b619-47c5-b62b-74855ec9bc52 req-d60b9f7d-9410-4c74-b984-1f338811166d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:03.585653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-b583f4da-b619-47c5-b62b-74855ec9bc52 req-d60b9f7d-9410-4c74-b984-1f338811166d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:03.658553 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-b583f4da-b619-47c5-b62b-74855ec9bc52 req-d60b9f7d-9410-4c74-b984-1f338811166d service nova] Creating event network-changed:43edbf74-9e3b-4e8e-9196-d531a42a98a9 for instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb on hv-cinder-83699 May 23 10:52:03.659482 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-b583f4da-b619-47c5-b62b-74855ec9bc52 req-d60b9f7d-9410-4c74-b984-1f338811166d service nova] Acquired lock "compute-rpcapi-router" {{(pid=129030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 10:52:03.660922 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-822b7034-c2eb-46f8-8249-be310ad358a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:03.662521 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-822b7034-c2eb-46f8-8249-be310ad358a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:03.663586 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-822b7034-c2eb-46f8-8249-be310ad358a9 None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:03.665141 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-822b7034-c2eb-46f8-8249-be310ad358a9 None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:03.711679 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.compute.rpcapi [None req-822b7034-c2eb-46f8-8249-be310ad358a9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 10:52:03.728536 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-822b7034-c2eb-46f8-8249-be310ad358a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=129030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 10:52:03.791000 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-822b7034-c2eb-46f8-8249-be310ad358a9 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.309930 May 23 10:52:03.791620 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 33/68] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:52:03.805273 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7ec55df0-37d6-4729-8e2a-2c97c543e0b7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:03.814669 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-7ec55df0-37d6-4729-8e2a-2c97c543e0b7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:03.835916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7ec55df0-37d6-4729-8e2a-2c97c543e0b7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:03.836665 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7ec55df0-37d6-4729-8e2a-2c97c543e0b7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:03.837623 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7ec55df0-37d6-4729-8e2a-2c97c543e0b7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:03.839674 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7ec55df0-37d6-4729-8e2a-2c97c543e0b7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:04.024253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] validate_networks() for [('f6500cd5-4edf-47aa-9e35-9691dad60917', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:52:04.042443 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-7ec55df0-37d6-4729-8e2a-2c97c543e0b7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:04.053187 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-7ec55df0-37d6-4729-8e2a-2c97c543e0b7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1296 microversion: 2.1 time: 0.256629 May 23 10:52:04.072316 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 34/69] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:03 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1296 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:04.078845 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4bf9e0e1-b5ef-43b4-a905-f704f282ceea tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:04.084018 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4bf9e0e1-b5ef-43b4-a905-f704f282ceea tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:04.126369 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4bf9e0e1-b5ef-43b4-a905-f704f282ceea tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:04.127110 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4bf9e0e1-b5ef-43b4-a905-f704f282ceea tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:04.131061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4bf9e0e1-b5ef-43b4-a905-f704f282ceea tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:04.132526 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4bf9e0e1-b5ef-43b4-a905-f704f282ceea tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:04.463028 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4bf9e0e1-b5ef-43b4-a905-f704f282ceea tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:04.477430 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4bf9e0e1-b5ef-43b4-a905-f704f282ceea tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.403299 May 23 10:52:04.478799 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 35/70] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:04 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:04.493063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d02fae41-14a7-44be-a200-cf6c4e4ca282 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:04.494993 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d02fae41-14a7-44be-a200-cf6c4e4ca282 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:04.504010 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d02fae41-14a7-44be-a200-cf6c4e4ca282 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:04.504774 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d02fae41-14a7-44be-a200-cf6c4e4ca282 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:04.506466 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d02fae41-14a7-44be-a200-cf6c4e4ca282 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:04.507060 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d02fae41-14a7-44be-a200-cf6c4e4ca282 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:04.793601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d02fae41-14a7-44be-a200-cf6c4e4ca282 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:04.820616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d02fae41-14a7-44be-a200-cf6c4e4ca282 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:04.826791 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d02fae41-14a7-44be-a200-cf6c4e4ca282 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:04.831931 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d02fae41-14a7-44be-a200-cf6c4e4ca282 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1332 microversion: 2.20 time: 0.348584 May 23 10:52:04.832726 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 36/71] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:04 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1332 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:05.072822 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-46513330-5838-431d-88d2-eab689881f22 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:05.073923 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-46513330-5838-431d-88d2-eab689881f22 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:05.084231 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-46513330-5838-431d-88d2-eab689881f22 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:05.089768 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-46513330-5838-431d-88d2-eab689881f22 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:05.090648 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-46513330-5838-431d-88d2-eab689881f22 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:05.091913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-46513330-5838-431d-88d2-eab689881f22 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:05.378744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-46513330-5838-431d-88d2-eab689881f22 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:05.387927 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-46513330-5838-431d-88d2-eab689881f22 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1294 microversion: 2.1 time: 0.319071 May 23 10:52:05.396249 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 37/72] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:05 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1294 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:05.417086 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:52:05.418034 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:52:05.418686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:52:05.419243 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:52:05.419802 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:52:05.432349 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:05.434484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:05.438151 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:05.438784 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:05.485825 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:52:05.496935 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-72be47b4-5be6-4913-af69-2d533ca45341 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:05.497847 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-72be47b4-5be6-4913-af69-2d533ca45341 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:05.500543 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for user 8e98c8ceac6b47079423b45685c5ba3e and project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:52:05.521675 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:52:05.524624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:52:05.531778 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-72be47b4-5be6-4913-af69-2d533ca45341 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:05.537489 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-72be47b4-5be6-4913-af69-2d533ca45341 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:05.543518 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-72be47b4-5be6-4913-af69-2d533ca45341 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:05.544071 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-72be47b4-5be6-4913-af69-2d533ca45341 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:05.660630 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-8a49f2d3-c911-4e39-b184-decabd271464 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.379771 May 23 10:52:05.667021 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 36/73] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:52:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:52:05.691627 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3dc24ce7-1549-4189-be33-964c9ba7293f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:05.692046 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3dc24ce7-1549-4189-be33-964c9ba7293f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:05.968217 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3dc24ce7-1549-4189-be33-964c9ba7293f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:05.975247 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3dc24ce7-1549-4189-be33-964c9ba7293f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1242 microversion: 2.1 time: 0.302602 May 23 10:52:05.986349 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 37/74] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:05 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1242 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:05.991337 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1ef21884-4d8a-4a39-9221-e2ea1b73da9a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:05.992173 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1ef21884-4d8a-4a39-9221-e2ea1b73da9a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:05.999003 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ef21884-4d8a-4a39-9221-e2ea1b73da9a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:06.002941 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ef21884-4d8a-4a39-9221-e2ea1b73da9a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:06.008783 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ef21884-4d8a-4a39-9221-e2ea1b73da9a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:06.009490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ef21884-4d8a-4a39-9221-e2ea1b73da9a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:06.250647 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1ef21884-4d8a-4a39-9221-e2ea1b73da9a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:06.263762 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1ef21884-4d8a-4a39-9221-e2ea1b73da9a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:06.271596 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1ef21884-4d8a-4a39-9221-e2ea1b73da9a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:06.275774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1ef21884-4d8a-4a39-9221-e2ea1b73da9a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1338 microversion: 2.20 time: 0.288277 May 23 10:52:06.278604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 38/75] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:05 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1338 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:06.413415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-16f3fb9b-5258-4056-bdf7-3ad3fec5f3ea tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:06.414060 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-16f3fb9b-5258-4056-bdf7-3ad3fec5f3ea tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:06.429600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-16f3fb9b-5258-4056-bdf7-3ad3fec5f3ea tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:06.430259 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-16f3fb9b-5258-4056-bdf7-3ad3fec5f3ea tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:06.431140 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-16f3fb9b-5258-4056-bdf7-3ad3fec5f3ea tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:06.431376 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-16f3fb9b-5258-4056-bdf7-3ad3fec5f3ea tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:06.771953 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-16f3fb9b-5258-4056-bdf7-3ad3fec5f3ea tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:06.784189 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-16f3fb9b-5258-4056-bdf7-3ad3fec5f3ea tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1294 microversion: 2.1 time: 0.374801 May 23 10:52:06.786018 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 39/76] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:06 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1294 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:52:06.993847 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5b9f1d30-fa28-4a24-84e2-3fa28c601f91 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:06.994295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5b9f1d30-fa28-4a24-84e2-3fa28c601f91 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:07.003495 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5b9f1d30-fa28-4a24-84e2-3fa28c601f91 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:07.003953 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5b9f1d30-fa28-4a24-84e2-3fa28c601f91 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:07.004726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5b9f1d30-fa28-4a24-84e2-3fa28c601f91 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:07.011838 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5b9f1d30-fa28-4a24-84e2-3fa28c601f91 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:07.160372 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5b9f1d30-fa28-4a24-84e2-3fa28c601f91 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:07.169214 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5b9f1d30-fa28-4a24-84e2-3fa28c601f91 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1238 microversion: 2.1 time: 0.181017 May 23 10:52:07.173301 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 40/77] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:06 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1238 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:07.295925 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2223a03c-d4e6-4070-9d4d-e443aaee45b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:07.296513 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2223a03c-d4e6-4070-9d4d-e443aaee45b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:07.298511 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:07.308101 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-72be47b4-5be6-4913-af69-2d533ca45341 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:07.309735 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2223a03c-d4e6-4070-9d4d-e443aaee45b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:07.310257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2223a03c-d4e6-4070-9d4d-e443aaee45b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:07.311064 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2223a03c-d4e6-4070-9d4d-e443aaee45b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:07.311491 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2223a03c-d4e6-4070-9d4d-e443aaee45b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:07.315548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=85 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:07.318172 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-72be47b4-5be6-4913-af69-2d533ca45341 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 1.827595 May 23 10:52:07.321938 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=41 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:07.329354 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 38/78] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:05 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:07.425884 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2223a03c-d4e6-4070-9d4d-e443aaee45b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:07.445478 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2223a03c-d4e6-4070-9d4d-e443aaee45b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:07.452419 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2223a03c-d4e6-4070-9d4d-e443aaee45b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:07.454717 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2223a03c-d4e6-4070-9d4d-e443aaee45b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1338 microversion: 2.20 time: 0.162568 May 23 10:52:07.464077 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 41/79] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:07 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1338 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:52:07.803085 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c8bd95b6-6102-4bd1-afef-4d621c7c8096 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:07.803873 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c8bd95b6-6102-4bd1-afef-4d621c7c8096 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:07.821780 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:07.825824 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c8bd95b6-6102-4bd1-afef-4d621c7c8096 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:07.826815 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c8bd95b6-6102-4bd1-afef-4d621c7c8096 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:07.827776 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c8bd95b6-6102-4bd1-afef-4d621c7c8096 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:07.828366 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c8bd95b6-6102-4bd1-afef-4d621c7c8096 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:07.926559 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c8bd95b6-6102-4bd1-afef-4d621c7c8096 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:07.946546 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c8bd95b6-6102-4bd1-afef-4d621c7c8096 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1294 microversion: 2.1 time: 0.147174 May 23 10:52:07.961681 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 39/80] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:07 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1294 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:08.193207 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d13544b0-a58c-420f-bf30-57d0070e0e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:08.193994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d13544b0-a58c-420f-bf30-57d0070e0e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:08.205710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d13544b0-a58c-420f-bf30-57d0070e0e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:08.206204 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d13544b0-a58c-420f-bf30-57d0070e0e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:08.206992 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d13544b0-a58c-420f-bf30-57d0070e0e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:08.207488 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d13544b0-a58c-420f-bf30-57d0070e0e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:08.325510 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d13544b0-a58c-420f-bf30-57d0070e0e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:08.334675 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d13544b0-a58c-420f-bf30-57d0070e0e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1294 microversion: 2.1 time: 0.145674 May 23 10:52:08.335104 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-cba2e635-02a0-430b-872b-491d1ede16e0 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:08.335714 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-cba2e635-02a0-430b-872b-491d1ede16e0 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:08.347518 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 42/81] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:08 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1294 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:08.355952 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cba2e635-02a0-430b-872b-491d1ede16e0 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:08.356413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cba2e635-02a0-430b-872b-491d1ede16e0 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:08.359961 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cba2e635-02a0-430b-872b-491d1ede16e0 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:08.360416 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cba2e635-02a0-430b-872b-491d1ede16e0 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:08.475345 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6fa2ada8-483f-4f81-bdf2-4c66a4a6da1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:08.476111 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6fa2ada8-483f-4f81-bdf2-4c66a4a6da1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:08.482591 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6fa2ada8-483f-4f81-bdf2-4c66a4a6da1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:08.483333 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6fa2ada8-483f-4f81-bdf2-4c66a4a6da1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:08.484322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6fa2ada8-483f-4f81-bdf2-4c66a4a6da1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:08.485157 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6fa2ada8-483f-4f81-bdf2-4c66a4a6da1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:08.627187 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-cba2e635-02a0-430b-872b-491d1ede16e0 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:08.636192 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-cba2e635-02a0-430b-872b-491d1ede16e0 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.305162 May 23 10:52:08.647219 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 40/82] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:08 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:08.747751 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6fa2ada8-483f-4f81-bdf2-4c66a4a6da1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:08.758667 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6fa2ada8-483f-4f81-bdf2-4c66a4a6da1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:08.764711 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6fa2ada8-483f-4f81-bdf2-4c66a4a6da1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:08.764711 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6fa2ada8-483f-4f81-bdf2-4c66a4a6da1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.293121 May 23 10:52:08.774430 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 43/83] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:08 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:52:08.965989 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6fc1ab4c-a0e1-4a28-8da9-9c32f53e3bc5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:08.966754 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6fc1ab4c-a0e1-4a28-8da9-9c32f53e3bc5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:08.978367 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6fc1ab4c-a0e1-4a28-8da9-9c32f53e3bc5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:08.979179 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6fc1ab4c-a0e1-4a28-8da9-9c32f53e3bc5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:08.981141 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6fc1ab4c-a0e1-4a28-8da9-9c32f53e3bc5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:08.982015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6fc1ab4c-a0e1-4a28-8da9-9c32f53e3bc5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:09.357868 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e8f9557f-bb2f-42fe-a3f3-5c4177555f8b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:09.359665 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e8f9557f-bb2f-42fe-a3f3-5c4177555f8b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:09.373996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e8f9557f-bb2f-42fe-a3f3-5c4177555f8b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:09.374433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e8f9557f-bb2f-42fe-a3f3-5c4177555f8b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:09.375244 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e8f9557f-bb2f-42fe-a3f3-5c4177555f8b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:09.379427 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e8f9557f-bb2f-42fe-a3f3-5c4177555f8b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:09.480056 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6fc1ab4c-a0e1-4a28-8da9-9c32f53e3bc5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:09.494894 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6fc1ab4c-a0e1-4a28-8da9-9c32f53e3bc5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.534653 May 23 10:52:09.504106 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e8f9557f-bb2f-42fe-a3f3-5c4177555f8b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:09.506373 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 41/84] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:08 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:09.519169 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e8f9557f-bb2f-42fe-a3f3-5c4177555f8b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1302 microversion: 2.1 time: 0.166418 May 23 10:52:09.520876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 44/85] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:09 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1302 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:09.655867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-edbf90d8-01da-48ec-9307-65c8446970b9 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:09.658304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-edbf90d8-01da-48ec-9307-65c8446970b9 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:09.686116 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-edbf90d8-01da-48ec-9307-65c8446970b9 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:09.686809 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-edbf90d8-01da-48ec-9307-65c8446970b9 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:09.688632 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-edbf90d8-01da-48ec-9307-65c8446970b9 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:09.689345 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-edbf90d8-01da-48ec-9307-65c8446970b9 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:09.783054 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-95ee9238-3459-4dd6-93c7-122082c87fca tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:09.783821 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-95ee9238-3459-4dd6-93c7-122082c87fca tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:09.797553 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95ee9238-3459-4dd6-93c7-122082c87fca tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:09.798265 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95ee9238-3459-4dd6-93c7-122082c87fca tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:09.799070 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95ee9238-3459-4dd6-93c7-122082c87fca tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:09.799513 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95ee9238-3459-4dd6-93c7-122082c87fca tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:10.200696 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-95ee9238-3459-4dd6-93c7-122082c87fca tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:10.212226 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-95ee9238-3459-4dd6-93c7-122082c87fca tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:10.215445 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-95ee9238-3459-4dd6-93c7-122082c87fca tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:10.216598 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-95ee9238-3459-4dd6-93c7-122082c87fca tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.437942 May 23 10:52:10.217172 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 45/86] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:09 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:10.409310 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-edbf90d8-01da-48ec-9307-65c8446970b9 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:10.421071 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-edbf90d8-01da-48ec-9307-65c8446970b9 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.770323 May 23 10:52:10.421786 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 42/87] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:09 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:10.514366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1823bf81-7502-4360-b875-ec44c4bf7210 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:10.515124 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1823bf81-7502-4360-b875-ec44c4bf7210 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:10.525634 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1823bf81-7502-4360-b875-ec44c4bf7210 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:10.528476 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1823bf81-7502-4360-b875-ec44c4bf7210 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:10.529747 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1823bf81-7502-4360-b875-ec44c4bf7210 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:10.530451 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1823bf81-7502-4360-b875-ec44c4bf7210 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:10.538437 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f477e834-8406-4b17-9230-efd91ef208c0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:10.539345 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f477e834-8406-4b17-9230-efd91ef208c0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:10.548702 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f477e834-8406-4b17-9230-efd91ef208c0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:10.550241 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f477e834-8406-4b17-9230-efd91ef208c0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:10.553245 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f477e834-8406-4b17-9230-efd91ef208c0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:10.554415 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f477e834-8406-4b17-9230-efd91ef208c0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:10.583905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=20 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:10.695977 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f477e834-8406-4b17-9230-efd91ef208c0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:10.709854 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f477e834-8406-4b17-9230-efd91ef208c0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1300 microversion: 2.1 time: 0.177093 May 23 10:52:10.711151 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 43/88] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:10 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1300 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:52:10.786777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1823bf81-7502-4360-b875-ec44c4bf7210 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:10.794865 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1823bf81-7502-4360-b875-ec44c4bf7210 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.286466 May 23 10:52:10.795647 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 46/89] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:10 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:11.236861 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-fefd2578-080c-4123-9263-a42916518600 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:11.238055 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-fefd2578-080c-4123-9263-a42916518600 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:11.257321 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fefd2578-080c-4123-9263-a42916518600 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:11.257770 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fefd2578-080c-4123-9263-a42916518600 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:11.262666 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fefd2578-080c-4123-9263-a42916518600 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:11.263315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fefd2578-080c-4123-9263-a42916518600 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:11.439811 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-acb7d6ac-9b2b-490d-a306-3ffe8ae117ec tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:11.440780 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-acb7d6ac-9b2b-490d-a306-3ffe8ae117ec tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:11.448774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-acb7d6ac-9b2b-490d-a306-3ffe8ae117ec tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:11.449528 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-acb7d6ac-9b2b-490d-a306-3ffe8ae117ec tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:11.450690 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-acb7d6ac-9b2b-490d-a306-3ffe8ae117ec tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:11.451363 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-acb7d6ac-9b2b-490d-a306-3ffe8ae117ec tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:11.727639 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-acb7d6ac-9b2b-490d-a306-3ffe8ae117ec tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:11.742148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-acb7d6ac-9b2b-490d-a306-3ffe8ae117ec tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.307378 May 23 10:52:11.743021 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 47/90] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:11 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:52:11.757382 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ab2e81d5-d424-4ccc-b5c3-82e578ebf5b5 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:11.758436 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ab2e81d5-d424-4ccc-b5c3-82e578ebf5b5 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:11.772296 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ab2e81d5-d424-4ccc-b5c3-82e578ebf5b5 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:11.773144 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ab2e81d5-d424-4ccc-b5c3-82e578ebf5b5 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:11.774230 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ab2e81d5-d424-4ccc-b5c3-82e578ebf5b5 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:11.774836 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ab2e81d5-d424-4ccc-b5c3-82e578ebf5b5 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:11.785773 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-fefd2578-080c-4123-9263-a42916518600 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:11.806227 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-fefd2578-080c-4123-9263-a42916518600 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:11.812868 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-fefd2578-080c-4123-9263-a42916518600 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:11.814070 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-fefd2578-080c-4123-9263-a42916518600 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.582330 May 23 10:52:11.825113 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 44/91] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:11 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:11.842155 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-205d3bc8-a428-499c-87f9-e3a5daaa8e6f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:11.842787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-205d3bc8-a428-499c-87f9-e3a5daaa8e6f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:11.874024 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-205d3bc8-a428-499c-87f9-e3a5daaa8e6f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:11.876351 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-205d3bc8-a428-499c-87f9-e3a5daaa8e6f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:11.879128 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-205d3bc8-a428-499c-87f9-e3a5daaa8e6f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:11.879831 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-205d3bc8-a428-499c-87f9-e3a5daaa8e6f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:11.944401 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ab2e81d5-d424-4ccc-b5c3-82e578ebf5b5 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:11.953464 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ab2e81d5-d424-4ccc-b5c3-82e578ebf5b5 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1300 microversion: 2.1 time: 0.209055 May 23 10:52:11.954713 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 48/92] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:11 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1300 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:12.106023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-205d3bc8-a428-499c-87f9-e3a5daaa8e6f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:12.117143 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-205d3bc8-a428-499c-87f9-e3a5daaa8e6f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.286870 May 23 10:52:12.126943 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 45/93] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:11 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:12.557872 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-22f5886f-5722-4d98-b3b1-c1d146469911 req-22aa2ef7-73a3-46eb-82e7-b11dfd48b1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4944e0-e16e-4fc7-af6e-bfc128b079a8", "tag": "fce62cd8-1ee5-4e76-b0ca-355710d5ec05"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:12.601236 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-22f5886f-5722-4d98-b3b1-c1d146469911 req-22aa2ef7-73a3-46eb-82e7-b11dfd48b1a1 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:12.603373 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-22f5886f-5722-4d98-b3b1-c1d146469911 req-22aa2ef7-73a3-46eb-82e7-b11dfd48b1a1 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:12.672127 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-22f5886f-5722-4d98-b3b1-c1d146469911 req-22aa2ef7-73a3-46eb-82e7-b11dfd48b1a1 service nova] Creating event network-changed:fce62cd8-1ee5-4e76-b0ca-355710d5ec05 for instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 on hv-cinder-83699 May 23 10:52:12.672892 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-22f5886f-5722-4d98-b3b1-c1d146469911 req-22aa2ef7-73a3-46eb-82e7-b11dfd48b1a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 10:52:12.675025 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a6e1e90f-c9b7-4b57-bc8c-be2e584624d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:12.675628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a6e1e90f-c9b7-4b57-bc8c-be2e584624d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:12.676748 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a6e1e90f-c9b7-4b57-bc8c-be2e584624d8 None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:12.677345 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a6e1e90f-c9b7-4b57-bc8c-be2e584624d8 None None] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:12.691999 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.compute.rpcapi [None req-a6e1e90f-c9b7-4b57-bc8c-be2e584624d8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 10:52:12.693504 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a6e1e90f-c9b7-4b57-bc8c-be2e584624d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=129029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 10:52:12.717902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a6e1e90f-c9b7-4b57-bc8c-be2e584624d8 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.645459 May 23 10:52:12.719052 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 49/94] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:52:12.759480 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-616960ea-0d1d-4947-bf7d-d8bb1b170aba tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:12.760330 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-616960ea-0d1d-4947-bf7d-d8bb1b170aba tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:12.767944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-616960ea-0d1d-4947-bf7d-d8bb1b170aba tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:12.768661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-616960ea-0d1d-4947-bf7d-d8bb1b170aba tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:12.769747 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-616960ea-0d1d-4947-bf7d-d8bb1b170aba tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:12.771290 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-616960ea-0d1d-4947-bf7d-d8bb1b170aba tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:12.832750 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e812b54e-d7a5-45b9-ac8d-17531ed7e549 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:12.834352 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e812b54e-d7a5-45b9-ac8d-17531ed7e549 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:12.848192 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e812b54e-d7a5-45b9-ac8d-17531ed7e549 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:12.848918 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e812b54e-d7a5-45b9-ac8d-17531ed7e549 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:12.850121 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e812b54e-d7a5-45b9-ac8d-17531ed7e549 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:12.852216 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e812b54e-d7a5-45b9-ac8d-17531ed7e549 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:12.992849 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-616960ea-0d1d-4947-bf7d-d8bb1b170aba tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:13.005715 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-616960ea-0d1d-4947-bf7d-d8bb1b170aba tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.249646 May 23 10:52:13.016452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 46/95] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:12 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:13.022283 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-fbb28de2-d3e7-49f9-acd7-e6e7966a48e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:13.022876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-fbb28de2-d3e7-49f9-acd7-e6e7966a48e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:13.030031 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fbb28de2-d3e7-49f9-acd7-e6e7966a48e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:13.030477 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fbb28de2-d3e7-49f9-acd7-e6e7966a48e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:13.031436 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fbb28de2-d3e7-49f9-acd7-e6e7966a48e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:13.032105 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fbb28de2-d3e7-49f9-acd7-e6e7966a48e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:13.108404 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-fbb28de2-d3e7-49f9-acd7-e6e7966a48e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:13.120380 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-fbb28de2-d3e7-49f9-acd7-e6e7966a48e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1300 microversion: 2.1 time: 0.101274 May 23 10:52:13.120985 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 47/96] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:13 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:13.134493 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f71f6c2d-fc22-4d68-91b0-26241ad51d45 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:13.135052 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f71f6c2d-fc22-4d68-91b0-26241ad51d45 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:13.149621 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f71f6c2d-fc22-4d68-91b0-26241ad51d45 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:13.150121 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f71f6c2d-fc22-4d68-91b0-26241ad51d45 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:13.151111 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f71f6c2d-fc22-4d68-91b0-26241ad51d45 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:13.155768 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f71f6c2d-fc22-4d68-91b0-26241ad51d45 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:13.271866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e812b54e-d7a5-45b9-ac8d-17531ed7e549 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:13.290254 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e812b54e-d7a5-45b9-ac8d-17531ed7e549 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:13.298545 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e812b54e-d7a5-45b9-ac8d-17531ed7e549 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:13.303469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e812b54e-d7a5-45b9-ac8d-17531ed7e549 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.475121 May 23 10:52:13.304076 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 50/97] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:12 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:13.390943 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f71f6c2d-fc22-4d68-91b0-26241ad51d45 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:13.399557 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f71f6c2d-fc22-4d68-91b0-26241ad51d45 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.268685 May 23 10:52:13.400155 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 48/98] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:13 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:14.023281 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d27bc43d-c34f-48e4-8b17-60efc2165275 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:14.024148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d27bc43d-c34f-48e4-8b17-60efc2165275 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:14.030573 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d27bc43d-c34f-48e4-8b17-60efc2165275 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:14.031000 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d27bc43d-c34f-48e4-8b17-60efc2165275 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:14.031848 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d27bc43d-c34f-48e4-8b17-60efc2165275 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:14.032512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d27bc43d-c34f-48e4-8b17-60efc2165275 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:14.139337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7ccc6ffc-61ce-46a7-9d43-ed32a9486da4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:14.139946 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-7ccc6ffc-61ce-46a7-9d43-ed32a9486da4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:14.143171 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=4 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:14.148165 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7ccc6ffc-61ce-46a7-9d43-ed32a9486da4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:14.151249 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7ccc6ffc-61ce-46a7-9d43-ed32a9486da4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:14.155536 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7ccc6ffc-61ce-46a7-9d43-ed32a9486da4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:14.156399 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7ccc6ffc-61ce-46a7-9d43-ed32a9486da4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:14.204712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d27bc43d-c34f-48e4-8b17-60efc2165275 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:14.212736 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d27bc43d-c34f-48e4-8b17-60efc2165275 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.193978 May 23 10:52:14.213317 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 51/99] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:14 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:14.313222 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-7ccc6ffc-61ce-46a7-9d43-ed32a9486da4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:14.322818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c747f136-93cc-48bf-af0f-34527b67b49f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:14.324374 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c747f136-93cc-48bf-af0f-34527b67b49f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:14.327675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-7ccc6ffc-61ce-46a7-9d43-ed32a9486da4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.193889 May 23 10:52:14.328710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 49/100] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:14 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:52:14.332014 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c747f136-93cc-48bf-af0f-34527b67b49f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:14.332636 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c747f136-93cc-48bf-af0f-34527b67b49f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:14.334119 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c747f136-93cc-48bf-af0f-34527b67b49f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:14.334947 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c747f136-93cc-48bf-af0f-34527b67b49f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:14.416722 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-516815c3-945d-4ed2-925f-13b58d360fc7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:14.420855 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-516815c3-945d-4ed2-925f-13b58d360fc7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:14.430547 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-516815c3-945d-4ed2-925f-13b58d360fc7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:14.432500 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-516815c3-945d-4ed2-925f-13b58d360fc7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:14.435024 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-516815c3-945d-4ed2-925f-13b58d360fc7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:14.436271 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-516815c3-945d-4ed2-925f-13b58d360fc7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:14.508579 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c747f136-93cc-48bf-af0f-34527b67b49f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:14.517293 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c747f136-93cc-48bf-af0f-34527b67b49f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:14.523035 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c747f136-93cc-48bf-af0f-34527b67b49f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:14.538309 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c747f136-93cc-48bf-af0f-34527b67b49f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.210865 May 23 10:52:14.541584 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 52/101] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:14 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:52:14.738563 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-2e392888-d943-4f6e-8e74-630c44d3df46 req-ac9e3363-ebaf-45a8-9602-e5597db723e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e61941d-0058-4809-83b9-676d70df112a", "tag": "5b53bf83-661d-4063-8ac0-99bf4069b7ab"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:14.761330 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-2e392888-d943-4f6e-8e74-630c44d3df46 req-ac9e3363-ebaf-45a8-9602-e5597db723e4 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:14.762185 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-2e392888-d943-4f6e-8e74-630c44d3df46 req-ac9e3363-ebaf-45a8-9602-e5597db723e4 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:14.794633 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-2e392888-d943-4f6e-8e74-630c44d3df46 req-ac9e3363-ebaf-45a8-9602-e5597db723e4 service nova] Creating event network-changed:5b53bf83-661d-4063-8ac0-99bf4069b7ab for instance 1e61941d-0058-4809-83b9-676d70df112a on hv-cinder-83699 May 23 10:52:14.804553 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-2e392888-d943-4f6e-8e74-630c44d3df46 req-ac9e3363-ebaf-45a8-9602-e5597db723e4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071029 May 23 10:52:14.808314 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 53/102] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:52:14.841121 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-516815c3-945d-4ed2-925f-13b58d360fc7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:14.850019 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-516815c3-945d-4ed2-925f-13b58d360fc7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.437065 May 23 10:52:14.850834 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 50/103] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:14 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:52:15.230083 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-86ab6450-b11d-4ae2-9749-a0c7506406ed tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:15.244030 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-86ab6450-b11d-4ae2-9749-a0c7506406ed tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:15.253754 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86ab6450-b11d-4ae2-9749-a0c7506406ed tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:15.254488 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86ab6450-b11d-4ae2-9749-a0c7506406ed tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:15.255760 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86ab6450-b11d-4ae2-9749-a0c7506406ed tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:15.256406 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86ab6450-b11d-4ae2-9749-a0c7506406ed tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:15.344799 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b84b3fd1-d35d-4e43-a0f7-b2744a5e3494 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:15.345412 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b84b3fd1-d35d-4e43-a0f7-b2744a5e3494 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:15.354639 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b84b3fd1-d35d-4e43-a0f7-b2744a5e3494 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:15.355009 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b84b3fd1-d35d-4e43-a0f7-b2744a5e3494 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:15.355786 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b84b3fd1-d35d-4e43-a0f7-b2744a5e3494 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:15.359582 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b84b3fd1-d35d-4e43-a0f7-b2744a5e3494 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:15.537028 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-86ab6450-b11d-4ae2-9749-a0c7506406ed tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:15.547894 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-86ab6450-b11d-4ae2-9749-a0c7506406ed tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.321814 May 23 10:52:15.548803 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 54/104] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:15 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:15.566370 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-29108a2d-6a3b-44d7-ba2b-3508a3d9de61 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:15.568032 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-29108a2d-6a3b-44d7-ba2b-3508a3d9de61 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:15.583726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-29108a2d-6a3b-44d7-ba2b-3508a3d9de61 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:15.583981 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-29108a2d-6a3b-44d7-ba2b-3508a3d9de61 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:15.585255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-29108a2d-6a3b-44d7-ba2b-3508a3d9de61 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:15.585851 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-29108a2d-6a3b-44d7-ba2b-3508a3d9de61 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:15.835191 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b84b3fd1-d35d-4e43-a0f7-b2744a5e3494 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:15.843448 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b84b3fd1-d35d-4e43-a0f7-b2744a5e3494 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.502362 May 23 10:52:15.846359 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 51/105] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:15 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:15.868966 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-18d87d75-3e72-46f1-b7a4-7584543408fc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:15.869812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-18d87d75-3e72-46f1-b7a4-7584543408fc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:15.877043 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-18d87d75-3e72-46f1-b7a4-7584543408fc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:15.878369 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-18d87d75-3e72-46f1-b7a4-7584543408fc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:15.879381 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-18d87d75-3e72-46f1-b7a4-7584543408fc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:15.880025 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-18d87d75-3e72-46f1-b7a4-7584543408fc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:15.975969 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=30 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:16.047224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-29108a2d-6a3b-44d7-ba2b-3508a3d9de61 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:16.063547 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-29108a2d-6a3b-44d7-ba2b-3508a3d9de61 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:16.066050 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-29108a2d-6a3b-44d7-ba2b-3508a3d9de61 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:16.068672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-29108a2d-6a3b-44d7-ba2b-3508a3d9de61 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.509921 May 23 10:52:16.070048 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 55/106] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:15 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:16.318020 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-18d87d75-3e72-46f1-b7a4-7584543408fc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:16.329364 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-18d87d75-3e72-46f1-b7a4-7584543408fc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.466470 May 23 10:52:16.331996 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 52/107] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:15 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:16.568077 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3c7c5a64-0e66-4b6f-9ee3-312e5c99d097 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:16.571389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3c7c5a64-0e66-4b6f-9ee3-312e5c99d097 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:16.591750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-7379c931-4a70-491b-94df-b61e7fe26cd7 req-c64b3250-61d4-4afd-bdee-b7675b196d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3019f51-1a3a-4457-a89a-9ba5759f792d", "tag": "0c4ac25b-ce3b-4b08-a309-9ebaccb55384"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:16.598246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3c7c5a64-0e66-4b6f-9ee3-312e5c99d097 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:16.602183 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3c7c5a64-0e66-4b6f-9ee3-312e5c99d097 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:16.603198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3c7c5a64-0e66-4b6f-9ee3-312e5c99d097 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:16.607209 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3c7c5a64-0e66-4b6f-9ee3-312e5c99d097 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:16.609580 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-7379c931-4a70-491b-94df-b61e7fe26cd7 req-c64b3250-61d4-4afd-bdee-b7675b196d66 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:16.617891 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-7379c931-4a70-491b-94df-b61e7fe26cd7 req-c64b3250-61d4-4afd-bdee-b7675b196d66 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:16.659599 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-7379c931-4a70-491b-94df-b61e7fe26cd7 req-c64b3250-61d4-4afd-bdee-b7675b196d66 service nova] Creating event network-changed:0c4ac25b-ce3b-4b08-a309-9ebaccb55384 for instance f3019f51-1a3a-4457-a89a-9ba5759f792d on hv-cinder-83699 May 23 10:52:16.668566 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-7379c931-4a70-491b-94df-b61e7fe26cd7 req-c64b3250-61d4-4afd-bdee-b7675b196d66 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080560 May 23 10:52:16.669253 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 53/108] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:52:16.832649 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3c7c5a64-0e66-4b6f-9ee3-312e5c99d097 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:16.842288 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3c7c5a64-0e66-4b6f-9ee3-312e5c99d097 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.279491 May 23 10:52:16.852253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 56/109] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:16 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:16.864669 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-446a6787-0599-4455-9a50-2fa29380cb97 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:16.865435 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-446a6787-0599-4455-9a50-2fa29380cb97 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:16.871828 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-446a6787-0599-4455-9a50-2fa29380cb97 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:16.872423 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-446a6787-0599-4455-9a50-2fa29380cb97 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:16.873198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-446a6787-0599-4455-9a50-2fa29380cb97 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:16.873638 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-446a6787-0599-4455-9a50-2fa29380cb97 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:17.008751 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-446a6787-0599-4455-9a50-2fa29380cb97 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:17.016549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-446a6787-0599-4455-9a50-2fa29380cb97 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.157384 May 23 10:52:17.017116 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 54/110] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:16 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:17.087634 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3dce74ad-02bc-4dcf-929c-ca656221cc50 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:17.088425 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3dce74ad-02bc-4dcf-929c-ca656221cc50 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:17.094448 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3dce74ad-02bc-4dcf-929c-ca656221cc50 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:17.094894 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3dce74ad-02bc-4dcf-929c-ca656221cc50 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:17.095648 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3dce74ad-02bc-4dcf-929c-ca656221cc50 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:17.096079 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3dce74ad-02bc-4dcf-929c-ca656221cc50 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:17.241699 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3dce74ad-02bc-4dcf-929c-ca656221cc50 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:17.253682 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3dce74ad-02bc-4dcf-929c-ca656221cc50 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:17.255272 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3dce74ad-02bc-4dcf-929c-ca656221cc50 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:17.256996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3dce74ad-02bc-4dcf-929c-ca656221cc50 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.173543 May 23 10:52:17.258310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 57/111] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:17 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:17.349398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3b9dd1d5-e62a-40a6-b18a-8bacc6c54057 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:17.349856 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3b9dd1d5-e62a-40a6-b18a-8bacc6c54057 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:17.360945 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b9dd1d5-e62a-40a6-b18a-8bacc6c54057 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:17.361417 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b9dd1d5-e62a-40a6-b18a-8bacc6c54057 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:17.362245 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b9dd1d5-e62a-40a6-b18a-8bacc6c54057 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:17.371324 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b9dd1d5-e62a-40a6-b18a-8bacc6c54057 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:17.535094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3b9dd1d5-e62a-40a6-b18a-8bacc6c54057 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:17.543880 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3b9dd1d5-e62a-40a6-b18a-8bacc6c54057 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.198945 May 23 10:52:17.545026 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 55/112] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:17 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:17.691567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-5a35ec0f-962e-4d08-99ab-7015a43f2b24 req-a0bb2bf2-1261-4612-9fe1-81ac0c34d933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a4d1f8-ff32-41e3-93ec-425c2fbabedb", "name": "network-vif-plugged", "status": "completed", "tag": "43edbf74-9e3b-4e8e-9196-d531a42a98a9"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:17.699723 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-5a35ec0f-962e-4d08-99ab-7015a43f2b24 req-a0bb2bf2-1261-4612-9fe1-81ac0c34d933 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:17.700242 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-5a35ec0f-962e-4d08-99ab-7015a43f2b24 req-a0bb2bf2-1261-4612-9fe1-81ac0c34d933 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:17.712360 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-5a35ec0f-962e-4d08-99ab-7015a43f2b24 req-a0bb2bf2-1261-4612-9fe1-81ac0c34d933 service nova] Creating event network-vif-plugged:43edbf74-9e3b-4e8e-9196-d531a42a98a9 for instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb on hv-cinder-83699 May 23 10:52:17.717240 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-5a35ec0f-962e-4d08-99ab-7015a43f2b24 req-a0bb2bf2-1261-4612-9fe1-81ac0c34d933 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092120 May 23 10:52:17.717831 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 58/113] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:52:17.861579 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2a999401-e3a1-4507-b164-d04e1134f506 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:17.862503 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2a999401-e3a1-4507-b164-d04e1134f506 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:17.871171 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2a999401-e3a1-4507-b164-d04e1134f506 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:17.871699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2a999401-e3a1-4507-b164-d04e1134f506 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:17.872554 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2a999401-e3a1-4507-b164-d04e1134f506 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:17.873004 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2a999401-e3a1-4507-b164-d04e1134f506 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:17.878490 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=100 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:18.019003 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2a999401-e3a1-4507-b164-d04e1134f506 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:18.027334 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2a999401-e3a1-4507-b164-d04e1134f506 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.171418 May 23 10:52:18.028925 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 56/114] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:17 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:18.036570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c1aedddd-e43b-481d-9ff1-4d04fe7210e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:18.037541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c1aedddd-e43b-481d-9ff1-4d04fe7210e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:18.047270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c1aedddd-e43b-481d-9ff1-4d04fe7210e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:18.047690 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c1aedddd-e43b-481d-9ff1-4d04fe7210e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:18.048518 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c1aedddd-e43b-481d-9ff1-4d04fe7210e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:18.049014 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c1aedddd-e43b-481d-9ff1-4d04fe7210e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:18.070286 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=100 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:18.200155 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c1aedddd-e43b-481d-9ff1-4d04fe7210e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:18.207605 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c1aedddd-e43b-481d-9ff1-4d04fe7210e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.177554 May 23 10:52:18.208395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 59/115] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:18 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:18.276791 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ccec6919-fa60-40c9-80b0-3682880c59d0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:18.277572 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ccec6919-fa60-40c9-80b0-3682880c59d0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:18.286442 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ccec6919-fa60-40c9-80b0-3682880c59d0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:18.309706 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ccec6919-fa60-40c9-80b0-3682880c59d0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:18.310770 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ccec6919-fa60-40c9-80b0-3682880c59d0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:18.311209 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ccec6919-fa60-40c9-80b0-3682880c59d0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:18.566057 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b7ae9703-35f0-4e80-93ac-f6f6f4419af0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:18.567345 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b7ae9703-35f0-4e80-93ac-f6f6f4419af0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:18.578663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7ae9703-35f0-4e80-93ac-f6f6f4419af0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:18.579282 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7ae9703-35f0-4e80-93ac-f6f6f4419af0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:18.580330 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7ae9703-35f0-4e80-93ac-f6f6f4419af0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:18.580917 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7ae9703-35f0-4e80-93ac-f6f6f4419af0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:18.882367 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b7ae9703-35f0-4e80-93ac-f6f6f4419af0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:18.897282 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b7ae9703-35f0-4e80-93ac-f6f6f4419af0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.338842 May 23 10:52:18.898215 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 60/116] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:18 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:52:18.923786 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ccec6919-fa60-40c9-80b0-3682880c59d0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:18.934661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ccec6919-fa60-40c9-80b0-3682880c59d0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:18.936872 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ccec6919-fa60-40c9-80b0-3682880c59d0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:18.938252 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ccec6919-fa60-40c9-80b0-3682880c59d0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.666006 May 23 10:52:18.938979 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 57/117] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:18 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:52:19.045625 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-26ec3718-f8ca-4447-8d6e-032f51078b9b tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:19.047049 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-26ec3718-f8ca-4447-8d6e-032f51078b9b tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:19.066461 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-26ec3718-f8ca-4447-8d6e-032f51078b9b tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:19.067552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-26ec3718-f8ca-4447-8d6e-032f51078b9b tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:19.069110 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-26ec3718-f8ca-4447-8d6e-032f51078b9b tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:19.069943 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-26ec3718-f8ca-4447-8d6e-032f51078b9b tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:19.236104 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bd5860db-838f-4c9d-8ef0-3d90f7bf8e15 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:19.236798 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-bd5860db-838f-4c9d-8ef0-3d90f7bf8e15 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:19.252498 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bd5860db-838f-4c9d-8ef0-3d90f7bf8e15 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:19.252958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bd5860db-838f-4c9d-8ef0-3d90f7bf8e15 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:19.256100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bd5860db-838f-4c9d-8ef0-3d90f7bf8e15 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:19.257942 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bd5860db-838f-4c9d-8ef0-3d90f7bf8e15 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:19.376809 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-26ec3718-f8ca-4447-8d6e-032f51078b9b tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:19.392152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-26ec3718-f8ca-4447-8d6e-032f51078b9b tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.350668 May 23 10:52:19.392749 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 61/118] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:19 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:19.647762 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-bd5860db-838f-4c9d-8ef0-3d90f7bf8e15 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:19.660455 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-bd5860db-838f-4c9d-8ef0-3d90f7bf8e15 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.428942 May 23 10:52:19.663027 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 58/119] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:19 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:19.914720 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b9f39582-ea70-4c40-a6b4-f91b7a1235af tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:19.915922 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b9f39582-ea70-4c40-a6b4-f91b7a1235af tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:19.922461 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b9f39582-ea70-4c40-a6b4-f91b7a1235af tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:19.922856 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b9f39582-ea70-4c40-a6b4-f91b7a1235af tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:19.923626 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b9f39582-ea70-4c40-a6b4-f91b7a1235af tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:19.924118 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b9f39582-ea70-4c40-a6b4-f91b7a1235af tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:19.958284 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d0eff66d-6b45-4285-8c72-cad67735d1b7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:19.959980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d0eff66d-6b45-4285-8c72-cad67735d1b7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:19.972085 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0eff66d-6b45-4285-8c72-cad67735d1b7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:19.973714 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0eff66d-6b45-4285-8c72-cad67735d1b7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:19.977045 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0eff66d-6b45-4285-8c72-cad67735d1b7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:19.977547 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0eff66d-6b45-4285-8c72-cad67735d1b7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:20.281066 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d0eff66d-6b45-4285-8c72-cad67735d1b7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:20.292699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d0eff66d-6b45-4285-8c72-cad67735d1b7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:20.294249 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d0eff66d-6b45-4285-8c72-cad67735d1b7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:20.295943 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d0eff66d-6b45-4285-8c72-cad67735d1b7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.342608 May 23 10:52:20.296935 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 59/120] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:19 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:52:20.409933 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-08108085-2812-4c39-8392-4043b2ff7ece tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:20.410605 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-08108085-2812-4c39-8392-4043b2ff7ece tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:20.417928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-08108085-2812-4c39-8392-4043b2ff7ece tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:20.418397 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-08108085-2812-4c39-8392-4043b2ff7ece tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:20.419350 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-08108085-2812-4c39-8392-4043b2ff7ece tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:20.419782 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-08108085-2812-4c39-8392-4043b2ff7ece tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:20.430592 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b9f39582-ea70-4c40-a6b4-f91b7a1235af tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:20.439146 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b9f39582-ea70-4c40-a6b4-f91b7a1235af tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.528784 May 23 10:52:20.446002 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 62/121] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:19 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:20.600693 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-08108085-2812-4c39-8392-4043b2ff7ece tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:20.608439 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-08108085-2812-4c39-8392-4043b2ff7ece tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.202567 May 23 10:52:20.609119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 60/122] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:20 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:52:20.680295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3068359c-d78f-4fe2-8519-549a87ab1a10 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:20.680868 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3068359c-d78f-4fe2-8519-549a87ab1a10 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:20.689037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3068359c-d78f-4fe2-8519-549a87ab1a10 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:20.689418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3068359c-d78f-4fe2-8519-549a87ab1a10 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:20.690263 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3068359c-d78f-4fe2-8519-549a87ab1a10 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:20.690925 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3068359c-d78f-4fe2-8519-549a87ab1a10 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:20.884914 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3068359c-d78f-4fe2-8519-549a87ab1a10 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:20.902742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3068359c-d78f-4fe2-8519-549a87ab1a10 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.225141 May 23 10:52:20.908548 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 63/123] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:20 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:21.317796 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-650101bd-daeb-4e6f-96a9-562c56b70464 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:21.318635 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-650101bd-daeb-4e6f-96a9-562c56b70464 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:21.328727 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-650101bd-daeb-4e6f-96a9-562c56b70464 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:21.329432 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-650101bd-daeb-4e6f-96a9-562c56b70464 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:21.330585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-650101bd-daeb-4e6f-96a9-562c56b70464 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:21.331730 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-650101bd-daeb-4e6f-96a9-562c56b70464 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:21.463590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1ec5fcbe-c3b3-4f2b-971b-83eec4790e11 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:21.464824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1ec5fcbe-c3b3-4f2b-971b-83eec4790e11 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:21.479806 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ec5fcbe-c3b3-4f2b-971b-83eec4790e11 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:21.480279 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ec5fcbe-c3b3-4f2b-971b-83eec4790e11 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:21.481156 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ec5fcbe-c3b3-4f2b-971b-83eec4790e11 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:21.482072 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ec5fcbe-c3b3-4f2b-971b-83eec4790e11 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:21.539568 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-650101bd-daeb-4e6f-96a9-562c56b70464 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:21.555478 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-650101bd-daeb-4e6f-96a9-562c56b70464 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:21.556986 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-650101bd-daeb-4e6f-96a9-562c56b70464 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:21.561528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-650101bd-daeb-4e6f-96a9-562c56b70464 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.250007 May 23 10:52:21.568697 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 61/124] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:21 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:21.624927 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-34dc5856-ab21-4837-a68f-70d40a00d379 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:21.625743 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-34dc5856-ab21-4837-a68f-70d40a00d379 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:21.631900 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34dc5856-ab21-4837-a68f-70d40a00d379 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:21.632534 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34dc5856-ab21-4837-a68f-70d40a00d379 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:21.633775 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34dc5856-ab21-4837-a68f-70d40a00d379 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:21.634364 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34dc5856-ab21-4837-a68f-70d40a00d379 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:21.685059 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1ec5fcbe-c3b3-4f2b-971b-83eec4790e11 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:21.692589 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1ec5fcbe-c3b3-4f2b-971b-83eec4790e11 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.239924 May 23 10:52:21.693156 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 64/125] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:21 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:21.788425 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-34dc5856-ab21-4837-a68f-70d40a00d379 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:21.796637 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-34dc5856-ab21-4837-a68f-70d40a00d379 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1314 microversion: 2.1 time: 0.175875 May 23 10:52:21.797507 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 62/126] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:21 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:21.920515 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-da580a3c-ff92-4108-938d-385868c16678 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:21.921122 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-da580a3c-ff92-4108-938d-385868c16678 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:21.933567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-da580a3c-ff92-4108-938d-385868c16678 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:21.934488 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-da580a3c-ff92-4108-938d-385868c16678 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:21.935343 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-da580a3c-ff92-4108-938d-385868c16678 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:21.935775 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-da580a3c-ff92-4108-938d-385868c16678 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:22.083440 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-d203d5d4-e291-454d-bcd9-ae35a89fb2be req-179b5f42-301c-435b-b16f-951e4180c3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4944e0-e16e-4fc7-af6e-bfc128b079a8", "name": "network-vif-plugged", "status": "completed", "tag": "fce62cd8-1ee5-4e76-b0ca-355710d5ec05"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:22.096821 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-d203d5d4-e291-454d-bcd9-ae35a89fb2be req-179b5f42-301c-435b-b16f-951e4180c3c5 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:22.097215 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-d203d5d4-e291-454d-bcd9-ae35a89fb2be req-179b5f42-301c-435b-b16f-951e4180c3c5 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:22.115556 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-d203d5d4-e291-454d-bcd9-ae35a89fb2be req-179b5f42-301c-435b-b16f-951e4180c3c5 service nova] Creating event network-vif-plugged:fce62cd8-1ee5-4e76-b0ca-355710d5ec05 for instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 on hv-cinder-83699 May 23 10:52:22.123214 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-d203d5d4-e291-454d-bcd9-ae35a89fb2be req-179b5f42-301c-435b-b16f-951e4180c3c5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043448 May 23 10:52:22.125074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 63/127] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:52:22.197594 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-da580a3c-ff92-4108-938d-385868c16678 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:22.205240 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-da580a3c-ff92-4108-938d-385868c16678 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.288405 May 23 10:52:22.205866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 65/128] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:21 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:22.587091 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ceae6801-0b23-497b-8aec-49bb05fde579 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:22.587918 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ceae6801-0b23-497b-8aec-49bb05fde579 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:22.596522 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ceae6801-0b23-497b-8aec-49bb05fde579 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:22.597179 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ceae6801-0b23-497b-8aec-49bb05fde579 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:22.598192 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ceae6801-0b23-497b-8aec-49bb05fde579 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:22.598894 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ceae6801-0b23-497b-8aec-49bb05fde579 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:22.712364 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-95b2d5b4-42c9-4e54-aa8b-a02b01dc6c06 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:22.715272 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-95b2d5b4-42c9-4e54-aa8b-a02b01dc6c06 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:22.728095 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=6 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:22.737141 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95b2d5b4-42c9-4e54-aa8b-a02b01dc6c06 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:22.738237 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95b2d5b4-42c9-4e54-aa8b-a02b01dc6c06 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:22.739358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95b2d5b4-42c9-4e54-aa8b-a02b01dc6c06 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:22.741604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95b2d5b4-42c9-4e54-aa8b-a02b01dc6c06 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:22.805661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ceae6801-0b23-497b-8aec-49bb05fde579 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:22.823407 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ceae6801-0b23-497b-8aec-49bb05fde579 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:22.825034 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ceae6801-0b23-497b-8aec-49bb05fde579 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:22.826207 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ceae6801-0b23-497b-8aec-49bb05fde579 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.244155 May 23 10:52:22.826776 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 64/129] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:22 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:22.842527 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-43df01ed-42ba-41c5-aeb0-c3db08676b2f tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:22.843395 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-43df01ed-42ba-41c5-aeb0-c3db08676b2f tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:22.851746 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-43df01ed-42ba-41c5-aeb0-c3db08676b2f tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:22.852225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-43df01ed-42ba-41c5-aeb0-c3db08676b2f tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:22.853018 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-43df01ed-42ba-41c5-aeb0-c3db08676b2f tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:22.853573 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-43df01ed-42ba-41c5-aeb0-c3db08676b2f tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:22.981359 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-95b2d5b4-42c9-4e54-aa8b-a02b01dc6c06 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:22.989286 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-95b2d5b4-42c9-4e54-aa8b-a02b01dc6c06 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.284483 May 23 10:52:22.991594 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 66/130] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:22 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:23.056628 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-43df01ed-42ba-41c5-aeb0-c3db08676b2f tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:23.064391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-43df01ed-42ba-41c5-aeb0-c3db08676b2f tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1500 microversion: 2.1 time: 0.225896 May 23 10:52:23.064964 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 65/131] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:22 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1500 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:23.228537 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4c3c76b3-85f0-4b81-a560-6464534f42f2 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:23.229065 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-4c3c76b3-85f0-4b81-a560-6464534f42f2 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:23.244310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4c3c76b3-85f0-4b81-a560-6464534f42f2 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:23.244767 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4c3c76b3-85f0-4b81-a560-6464534f42f2 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:23.245538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4c3c76b3-85f0-4b81-a560-6464534f42f2 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:23.245991 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4c3c76b3-85f0-4b81-a560-6464534f42f2 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:23.428863 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-4c3c76b3-85f0-4b81-a560-6464534f42f2 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:23.438401 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4c3c76b3-85f0-4b81-a560-6464534f42f2 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.213594 May 23 10:52:23.439639 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 67/132] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:23 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:23.844947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ec3461a3-2b45-4f7a-856f-84e1f85972af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:23.845637 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ec3461a3-2b45-4f7a-856f-84e1f85972af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:23.851719 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ec3461a3-2b45-4f7a-856f-84e1f85972af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:23.852168 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ec3461a3-2b45-4f7a-856f-84e1f85972af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:23.852928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ec3461a3-2b45-4f7a-856f-84e1f85972af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:23.853355 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ec3461a3-2b45-4f7a-856f-84e1f85972af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:23.993273 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ec3461a3-2b45-4f7a-856f-84e1f85972af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:24.008410 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ec3461a3-2b45-4f7a-856f-84e1f85972af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:24.010392 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3f0dd6ed-2f92-4496-9064-2d3e3b12c907 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:24.010966 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3f0dd6ed-2f92-4496-9064-2d3e3b12c907 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:24.011458 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ec3461a3-2b45-4f7a-856f-84e1f85972af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:24.012853 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ec3461a3-2b45-4f7a-856f-84e1f85972af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.171984 May 23 10:52:24.013482 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 66/133] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:23 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:24.019118 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f0dd6ed-2f92-4496-9064-2d3e3b12c907 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:24.019452 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f0dd6ed-2f92-4496-9064-2d3e3b12c907 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:24.020992 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f0dd6ed-2f92-4496-9064-2d3e3b12c907 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:24.021599 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f0dd6ed-2f92-4496-9064-2d3e3b12c907 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:24.151220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-ac1cbbc4-33a2-44d3-aea6-f37afce4b0de req-acd55307-64e6-4423-989f-62347bd01d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61941d-0058-4809-83b9-676d70df112a", "name": "network-vif-plugged", "status": "completed", "tag": "5b53bf83-661d-4063-8ac0-99bf4069b7ab"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:24.159374 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-ac1cbbc4-33a2-44d3-aea6-f37afce4b0de req-acd55307-64e6-4423-989f-62347bd01d88 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:24.160089 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-ac1cbbc4-33a2-44d3-aea6-f37afce4b0de req-acd55307-64e6-4423-989f-62347bd01d88 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:24.165805 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3f0dd6ed-2f92-4496-9064-2d3e3b12c907 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:24.173145 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-ac1cbbc4-33a2-44d3-aea6-f37afce4b0de req-acd55307-64e6-4423-989f-62347bd01d88 service nova] Creating event network-vif-plugged:5b53bf83-661d-4063-8ac0-99bf4069b7ab for instance 1e61941d-0058-4809-83b9-676d70df112a on hv-cinder-83699 May 23 10:52:24.177222 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3f0dd6ed-2f92-4496-9064-2d3e3b12c907 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.172174 May 23 10:52:24.178419 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 68/134] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:24 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:52:24.178992 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-ac1cbbc4-33a2-44d3-aea6-f37afce4b0de req-acd55307-64e6-4423-989f-62347bd01d88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031578 May 23 10:52:24.179576 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 67/135] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:52:24.455597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8515b4c2-1e1f-48d3-be37-dbd80fbbf35b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:24.456209 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-8515b4c2-1e1f-48d3-be37-dbd80fbbf35b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:24.462348 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8515b4c2-1e1f-48d3-be37-dbd80fbbf35b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:24.462801 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8515b4c2-1e1f-48d3-be37-dbd80fbbf35b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:24.463598 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8515b4c2-1e1f-48d3-be37-dbd80fbbf35b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:24.464033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8515b4c2-1e1f-48d3-be37-dbd80fbbf35b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:24.595544 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-8515b4c2-1e1f-48d3-be37-dbd80fbbf35b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:24.603895 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-8515b4c2-1e1f-48d3-be37-dbd80fbbf35b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.152254 May 23 10:52:24.604666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 69/136] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:24 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:25.030881 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-83e84a6d-4027-4850-bc71-946d24359ba4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:25.032695 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-83e84a6d-4027-4850-bc71-946d24359ba4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:25.043379 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-83e84a6d-4027-4850-bc71-946d24359ba4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:25.044233 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-83e84a6d-4027-4850-bc71-946d24359ba4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:25.055454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-83e84a6d-4027-4850-bc71-946d24359ba4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:25.056146 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-83e84a6d-4027-4850-bc71-946d24359ba4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:25.197086 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e7770c3a-778f-4043-af91-3daabfab155d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:25.198954 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e7770c3a-778f-4043-af91-3daabfab155d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:25.210730 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7770c3a-778f-4043-af91-3daabfab155d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:25.211187 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7770c3a-778f-4043-af91-3daabfab155d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:25.212001 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7770c3a-778f-4043-af91-3daabfab155d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:25.212440 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7770c3a-778f-4043-af91-3daabfab155d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:25.243136 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-83e84a6d-4027-4850-bc71-946d24359ba4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:25.252805 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-83e84a6d-4027-4850-bc71-946d24359ba4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:25.254882 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-83e84a6d-4027-4850-bc71-946d24359ba4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:25.256076 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-83e84a6d-4027-4850-bc71-946d24359ba4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.229348 May 23 10:52:25.258235 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 68/137] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:25 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:25.350799 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e7770c3a-778f-4043-af91-3daabfab155d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:25.358195 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e7770c3a-778f-4043-af91-3daabfab155d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1362 microversion: 2.1 time: 0.167227 May 23 10:52:25.359203 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 70/138] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:25 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:25.620653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d5df4b86-e6b7-4bfe-9d67-22e163b549c4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:25.621369 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d5df4b86-e6b7-4bfe-9d67-22e163b549c4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:25.627457 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d5df4b86-e6b7-4bfe-9d67-22e163b549c4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:25.627982 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d5df4b86-e6b7-4bfe-9d67-22e163b549c4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:25.628824 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d5df4b86-e6b7-4bfe-9d67-22e163b549c4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:25.629898 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d5df4b86-e6b7-4bfe-9d67-22e163b549c4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:25.797701 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d5df4b86-e6b7-4bfe-9d67-22e163b549c4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:25.806963 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d5df4b86-e6b7-4bfe-9d67-22e163b549c4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.190081 May 23 10:52:25.807764 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 69/139] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:25 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:26.276258 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ee699082-8ad0-4160-a862-b536cf03ecbf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:26.278482 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ee699082-8ad0-4160-a862-b536cf03ecbf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:26.287104 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ee699082-8ad0-4160-a862-b536cf03ecbf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:26.287840 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ee699082-8ad0-4160-a862-b536cf03ecbf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:26.288877 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ee699082-8ad0-4160-a862-b536cf03ecbf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:26.289573 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ee699082-8ad0-4160-a862-b536cf03ecbf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:26.376105 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-cade7d59-12ab-4af0-a9c4-a98eb15be17c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:26.376725 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-cade7d59-12ab-4af0-a9c4-a98eb15be17c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:26.383210 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cade7d59-12ab-4af0-a9c4-a98eb15be17c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:26.383663 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cade7d59-12ab-4af0-a9c4-a98eb15be17c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:26.384484 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cade7d59-12ab-4af0-a9c4-a98eb15be17c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:26.385165 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cade7d59-12ab-4af0-a9c4-a98eb15be17c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:26.454890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ee699082-8ad0-4160-a862-b536cf03ecbf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:26.464510 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ee699082-8ad0-4160-a862-b536cf03ecbf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:26.466157 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ee699082-8ad0-4160-a862-b536cf03ecbf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:26.467284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ee699082-8ad0-4160-a862-b536cf03ecbf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.196125 May 23 10:52:26.468019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 71/140] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:26 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:52:26.535811 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-cade7d59-12ab-4af0-a9c4-a98eb15be17c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:26.544463 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-cade7d59-12ab-4af0-a9c4-a98eb15be17c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1548 microversion: 2.1 time: 0.173419 May 23 10:52:26.545035 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 70/141] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:26 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:26.562270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3873f313-e911-46c2-9ee9-6ad6c8e88d97 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:26.562832 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3873f313-e911-46c2-9ee9-6ad6c8e88d97 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:26.573224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3873f313-e911-46c2-9ee9-6ad6c8e88d97 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:26.573671 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3873f313-e911-46c2-9ee9-6ad6c8e88d97 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:26.574482 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3873f313-e911-46c2-9ee9-6ad6c8e88d97 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:26.575087 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3873f313-e911-46c2-9ee9-6ad6c8e88d97 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:26.581577 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4587c745-cf71-4134-a377-62532a3dc69d tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ce2f957-3c9b-40b5-a661-20ad89632898"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:26.583323 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4587c745-cf71-4134-a377-62532a3dc69d tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:26.589687 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4587c745-cf71-4134-a377-62532a3dc69d tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:26.590186 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4587c745-cf71-4134-a377-62532a3dc69d tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:26.590965 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4587c745-cf71-4134-a377-62532a3dc69d tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:26.591385 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4587c745-cf71-4134-a377-62532a3dc69d tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:26.717214 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3873f313-e911-46c2-9ee9-6ad6c8e88d97 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159247 May 23 10:52:26.724210 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 72/142] 10.222.0.36 () {58 vars in 1274 bytes} [Mon May 23 10:52:26 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:52:26.824469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-130d161f-0d2b-464a-af18-cd6127ee7143 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:26.824994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-130d161f-0d2b-464a-af18-cd6127ee7143 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:26.831141 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-130d161f-0d2b-464a-af18-cd6127ee7143 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:26.831767 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-130d161f-0d2b-464a-af18-cd6127ee7143 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:26.833378 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-130d161f-0d2b-464a-af18-cd6127ee7143 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:26.833853 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-130d161f-0d2b-464a-af18-cd6127ee7143 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:26.991783 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-130d161f-0d2b-464a-af18-cd6127ee7143 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:27.002819 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-130d161f-0d2b-464a-af18-cd6127ee7143 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.182456 May 23 10:52:27.003399 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 73/143] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:26 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:27.487423 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-386e143c-fbcc-4b87-ad8e-adb8e0938934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:27.489237 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-386e143c-fbcc-4b87-ad8e-adb8e0938934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:27.499390 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-386e143c-fbcc-4b87-ad8e-adb8e0938934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:27.503165 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-386e143c-fbcc-4b87-ad8e-adb8e0938934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:27.504626 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-386e143c-fbcc-4b87-ad8e-adb8e0938934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:27.505085 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-386e143c-fbcc-4b87-ad8e-adb8e0938934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:27.814315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4587c745-cf71-4134-a377-62532a3dc69d tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "POST /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.236693 May 23 10:52:27.815705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 71/144] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:52:26 2022] POST /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb/os-volume_attachments => generated 194 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:52:27.847355 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-386e143c-fbcc-4b87-ad8e-adb8e0938934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:27.855562 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-386e143c-fbcc-4b87-ad8e-adb8e0938934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:27.857321 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-386e143c-fbcc-4b87-ad8e-adb8e0938934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:27.858636 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-386e143c-fbcc-4b87-ad8e-adb8e0938934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1404 microversion: 2.20 time: 0.376802 May 23 10:52:27.859343 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 74/145] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:27 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1404 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:52:28.021473 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a829b22a-3352-4126-9b75-ed397f3d0bb8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:28.022526 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a829b22a-3352-4126-9b75-ed397f3d0bb8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:28.030904 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a829b22a-3352-4126-9b75-ed397f3d0bb8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:28.031816 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a829b22a-3352-4126-9b75-ed397f3d0bb8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:28.032884 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a829b22a-3352-4126-9b75-ed397f3d0bb8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:28.033527 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a829b22a-3352-4126-9b75-ed397f3d0bb8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:28.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-9571294a-9b36-4456-b085-85d609f5c2d6 req-55bd3b81-abbc-40e5-b518-7735a9f33018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3019f51-1a3a-4457-a89a-9ba5759f792d", "name": "network-vif-plugged", "status": "completed", "tag": "0c4ac25b-ce3b-4b08-a309-9ebaccb55384"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:28.110488 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-9571294a-9b36-4456-b085-85d609f5c2d6 req-55bd3b81-abbc-40e5-b518-7735a9f33018 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:28.112941 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-9571294a-9b36-4456-b085-85d609f5c2d6 req-55bd3b81-abbc-40e5-b518-7735a9f33018 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:28.141058 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-9571294a-9b36-4456-b085-85d609f5c2d6 req-55bd3b81-abbc-40e5-b518-7735a9f33018 service nova] Creating event network-vif-plugged:0c4ac25b-ce3b-4b08-a309-9ebaccb55384 for instance f3019f51-1a3a-4457-a89a-9ba5759f792d on hv-cinder-83699 May 23 10:52:28.149645 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-9571294a-9b36-4456-b085-85d609f5c2d6 req-55bd3b81-abbc-40e5-b518-7735a9f33018 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073462 May 23 10:52:28.150842 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 75/146] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:52:28.333749 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-27981179-edf1-416d-9e1e-ae0c5f797a61 req-21fac631-f3b1-481f-80b6-1896e3e0a006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4944e0-e16e-4fc7-af6e-bfc128b079a8", "tag": "fce62cd8-1ee5-4e76-b0ca-355710d5ec05"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:28.347544 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-27981179-edf1-416d-9e1e-ae0c5f797a61 req-21fac631-f3b1-481f-80b6-1896e3e0a006 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:28.348877 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-27981179-edf1-416d-9e1e-ae0c5f797a61 req-21fac631-f3b1-481f-80b6-1896e3e0a006 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:28.361628 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a829b22a-3352-4126-9b75-ed397f3d0bb8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:28.364058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:28.368325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-27981179-edf1-416d-9e1e-ae0c5f797a61 req-21fac631-f3b1-481f-80b6-1896e3e0a006 service nova] Creating event network-changed:fce62cd8-1ee5-4e76-b0ca-355710d5ec05 for instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 on hv-cinder-83699 May 23 10:52:28.373446 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a829b22a-3352-4126-9b75-ed397f3d0bb8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.356351 May 23 10:52:28.374105 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 72/147] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:28 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:28.375016 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-27981179-edf1-416d-9e1e-ae0c5f797a61 req-21fac631-f3b1-481f-80b6-1896e3e0a006 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046408 May 23 10:52:28.380154 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 76/148] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:52:28.877072 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1c7ca3bc-8b19-43bb-bb2d-e2a4766c709b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:28.877617 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1c7ca3bc-8b19-43bb-bb2d-e2a4766c709b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:28.888986 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1c7ca3bc-8b19-43bb-bb2d-e2a4766c709b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:28.889704 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1c7ca3bc-8b19-43bb-bb2d-e2a4766c709b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:28.890853 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1c7ca3bc-8b19-43bb-bb2d-e2a4766c709b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:28.891696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1c7ca3bc-8b19-43bb-bb2d-e2a4766c709b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:29.284891 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1c7ca3bc-8b19-43bb-bb2d-e2a4766c709b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:29.295960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1c7ca3bc-8b19-43bb-bb2d-e2a4766c709b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:29.297699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1c7ca3bc-8b19-43bb-bb2d-e2a4766c709b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:29.298903 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1c7ca3bc-8b19-43bb-bb2d-e2a4766c709b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1597 microversion: 2.20 time: 0.426162 May 23 10:52:29.299637 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 73/149] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:52:28 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1597 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:52:29.318624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-590708c0-128d-4589-bba9-0a178cebc845 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:29.319851 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-590708c0-128d-4589-bba9-0a178cebc845 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:29.327980 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-590708c0-128d-4589-bba9-0a178cebc845 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:29.328452 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-590708c0-128d-4589-bba9-0a178cebc845 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:29.329352 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-590708c0-128d-4589-bba9-0a178cebc845 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:29.329891 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-590708c0-128d-4589-bba9-0a178cebc845 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:29.390790 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-49900a91-6ee8-4a42-8d58-e5919ad303f7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:29.391808 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-49900a91-6ee8-4a42-8d58-e5919ad303f7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:29.398595 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49900a91-6ee8-4a42-8d58-e5919ad303f7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:29.399050 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49900a91-6ee8-4a42-8d58-e5919ad303f7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:29.399822 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49900a91-6ee8-4a42-8d58-e5919ad303f7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:29.400267 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49900a91-6ee8-4a42-8d58-e5919ad303f7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:29.447541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-590708c0-128d-4589-bba9-0a178cebc845 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.133918 May 23 10:52:29.448135 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 77/150] 10.222.0.36 () {60 vars in 1315 bytes} [Mon May 23 10:52:29 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:52:29.557942 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-49900a91-6ee8-4a42-8d58-e5919ad303f7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:29.570650 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-49900a91-6ee8-4a42-8d58-e5919ad303f7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.183803 May 23 10:52:29.571433 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 74/151] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:29 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:30.588738 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c0d9cbd5-80f2-426c-9091-c2f2bd3f2c2f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:30.589942 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c0d9cbd5-80f2-426c-9091-c2f2bd3f2c2f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:30.600567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c0d9cbd5-80f2-426c-9091-c2f2bd3f2c2f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:30.602179 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c0d9cbd5-80f2-426c-9091-c2f2bd3f2c2f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:30.603983 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c0d9cbd5-80f2-426c-9091-c2f2bd3f2c2f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:30.605334 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c0d9cbd5-80f2-426c-9091-c2f2bd3f2c2f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:30.611003 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=100 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:30.828274 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c0d9cbd5-80f2-426c-9091-c2f2bd3f2c2f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:30.837128 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c0d9cbd5-80f2-426c-9091-c2f2bd3f2c2f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.253130 May 23 10:52:30.847048 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 78/152] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:30 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:31.000944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-4de2b6c6-3c24-4acb-84f9-82d9fa7c1480 req-90044459-3732-46bb-b2a1-3d0c08e54cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e61941d-0058-4809-83b9-676d70df112a", "tag": "5b53bf83-661d-4063-8ac0-99bf4069b7ab"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:31.010058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-4de2b6c6-3c24-4acb-84f9-82d9fa7c1480 req-90044459-3732-46bb-b2a1-3d0c08e54cd8 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:31.010716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-4de2b6c6-3c24-4acb-84f9-82d9fa7c1480 req-90044459-3732-46bb-b2a1-3d0c08e54cd8 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:31.021893 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-4de2b6c6-3c24-4acb-84f9-82d9fa7c1480 req-90044459-3732-46bb-b2a1-3d0c08e54cd8 service nova] Creating event network-changed:5b53bf83-661d-4063-8ac0-99bf4069b7ab for instance 1e61941d-0058-4809-83b9-676d70df112a on hv-cinder-83699 May 23 10:52:31.026880 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-4de2b6c6-3c24-4acb-84f9-82d9fa7c1480 req-90044459-3732-46bb-b2a1-3d0c08e54cd8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030121 May 23 10:52:31.027470 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 75/153] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:52:31.853848 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fa5217a1-e982-40b3-8921-6f93e7f52538 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:31.854831 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-fa5217a1-e982-40b3-8921-6f93e7f52538 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:31.861285 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa5217a1-e982-40b3-8921-6f93e7f52538 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:31.861902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa5217a1-e982-40b3-8921-6f93e7f52538 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:31.862885 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa5217a1-e982-40b3-8921-6f93e7f52538 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:31.863804 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa5217a1-e982-40b3-8921-6f93e7f52538 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:32.021439 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fa5217a1-e982-40b3-8921-6f93e7f52538 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:32.029112 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fa5217a1-e982-40b3-8921-6f93e7f52538 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1368 microversion: 2.1 time: 0.178970 May 23 10:52:32.029691 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 79/154] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:31 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:33.048141 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-fedd2d06-f956-46a9-86b9-69596ae9469e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:33.048837 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-fedd2d06-f956-46a9-86b9-69596ae9469e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:33.060748 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fedd2d06-f956-46a9-86b9-69596ae9469e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:33.061349 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fedd2d06-f956-46a9-86b9-69596ae9469e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:33.062801 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fedd2d06-f956-46a9-86b9-69596ae9469e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:33.063250 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fedd2d06-f956-46a9-86b9-69596ae9469e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:33.214140 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-fedd2d06-f956-46a9-86b9-69596ae9469e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:33.222588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-fedd2d06-f956-46a9-86b9-69596ae9469e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1558 microversion: 2.1 time: 0.180569 May 23 10:52:33.223467 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 76/155] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:33 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:33.256840 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-40124b79-4377-4367-9f2e-4376f847e152 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:33.257789 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-40124b79-4377-4367-9f2e-4376f847e152 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:33.265446 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-40124b79-4377-4367-9f2e-4376f847e152 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:33.265908 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-40124b79-4377-4367-9f2e-4376f847e152 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:33.267888 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-40124b79-4377-4367-9f2e-4376f847e152 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:33.268605 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-40124b79-4377-4367-9f2e-4376f847e152 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:33.427018 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-40124b79-4377-4367-9f2e-4376f847e152 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180977 May 23 10:52:33.427624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 80/156] 10.222.0.36 () {58 vars in 1274 bytes} [Mon May 23 10:52:33 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:52:34.553661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-edc99271-4645-4e56-8d56-152f779a314b req-4baa9270-bda9-4aa1-9035-8ad3ae49cfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3019f51-1a3a-4457-a89a-9ba5759f792d", "tag": "0c4ac25b-ce3b-4b08-a309-9ebaccb55384"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:34.562309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-edc99271-4645-4e56-8d56-152f779a314b req-4baa9270-bda9-4aa1-9035-8ad3ae49cfc2 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:34.562751 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-edc99271-4645-4e56-8d56-152f779a314b req-4baa9270-bda9-4aa1-9035-8ad3ae49cfc2 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:34.575337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-edc99271-4645-4e56-8d56-152f779a314b req-4baa9270-bda9-4aa1-9035-8ad3ae49cfc2 service nova] Creating event network-changed:0c4ac25b-ce3b-4b08-a309-9ebaccb55384 for instance f3019f51-1a3a-4457-a89a-9ba5759f792d on hv-cinder-83699 May 23 10:52:34.580677 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-edc99271-4645-4e56-8d56-152f779a314b req-4baa9270-bda9-4aa1-9035-8ad3ae49cfc2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030574 May 23 10:52:34.581726 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 77/157] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:52:41.978480 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-02b65a2c-5b7f-4cbc-ae11-2040e6ae8c4e tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:41.979573 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-02b65a2c-5b7f-4cbc-ae11-2040e6ae8c4e tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:41.981579 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=80 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:41.986862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-02b65a2c-5b7f-4cbc-ae11-2040e6ae8c4e tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:41.987498 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-02b65a2c-5b7f-4cbc-ae11-2040e6ae8c4e tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:41.988891 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-02b65a2c-5b7f-4cbc-ae11-2040e6ae8c4e tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:41.989330 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-02b65a2c-5b7f-4cbc-ae11-2040e6ae8c4e tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:42.016884 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-02b65a2c-5b7f-4cbc-ae11-2040e6ae8c4e tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:52:42.149467 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-02b65a2c-5b7f-4cbc-ae11-2040e6ae8c4e tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "DELETE /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 204 len: 0 microversion: 2.1 time: 0.174555 May 23 10:52:42.150413 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 81/158] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:52:41 2022] DELETE /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:52:42.160840 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-facb5295-3c7a-471a-8100-52d96927b769 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:42.163179 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-facb5295-3c7a-471a-8100-52d96927b769 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:42.166102 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=78 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:52:42.172381 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-facb5295-3c7a-471a-8100-52d96927b769 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:42.172821 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-facb5295-3c7a-471a-8100-52d96927b769 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:42.173754 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-facb5295-3c7a-471a-8100-52d96927b769 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:42.174737 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-facb5295-3c7a-471a-8100-52d96927b769 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:42.358550 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-facb5295-3c7a-471a-8100-52d96927b769 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:42.367508 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-facb5295-3c7a-471a-8100-52d96927b769 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1552 microversion: 2.1 time: 0.212854 May 23 10:52:42.368152 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 78/159] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:42 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1552 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:43.387241 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b4ed10a0-f8d2-488d-b181-c774ebbde7ae tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:43.387738 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b4ed10a0-f8d2-488d-b181-c774ebbde7ae tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:43.395507 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b4ed10a0-f8d2-488d-b181-c774ebbde7ae tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:43.395947 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b4ed10a0-f8d2-488d-b181-c774ebbde7ae tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:43.396896 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b4ed10a0-f8d2-488d-b181-c774ebbde7ae tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:43.397486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b4ed10a0-f8d2-488d-b181-c774ebbde7ae tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:43.567311 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b4ed10a0-f8d2-488d-b181-c774ebbde7ae tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:43.577602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b4ed10a0-f8d2-488d-b181-c774ebbde7ae tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1552 microversion: 2.1 time: 0.195384 May 23 10:52:43.578876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 82/160] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:43 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1552 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:44.595574 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-073295b1-0ad6-477e-93a3-ac9c22b5dc97 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:44.596188 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-073295b1-0ad6-477e-93a3-ac9c22b5dc97 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:44.603172 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-073295b1-0ad6-477e-93a3-ac9c22b5dc97 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:44.603619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-073295b1-0ad6-477e-93a3-ac9c22b5dc97 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:44.604382 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-073295b1-0ad6-477e-93a3-ac9c22b5dc97 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:44.604821 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-073295b1-0ad6-477e-93a3-ac9c22b5dc97 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:44.742466 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-073295b1-0ad6-477e-93a3-ac9c22b5dc97 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:44.750758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-073295b1-0ad6-477e-93a3-ac9c22b5dc97 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1552 microversion: 2.1 time: 0.159011 May 23 10:52:44.751498 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 79/161] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:44 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:44.848052 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-58b64404-5208-4b06-9430-971dd83939f6 req-8cc4ea26-0306-4bcf-a62a-5f2f40733156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a4d1f8-ff32-41e3-93ec-425c2fbabedb", "name": "network-vif-deleted", "tag": "43edbf74-9e3b-4e8e-9196-d531a42a98a9"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:52:44.857759 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-58b64404-5208-4b06-9430-971dd83939f6 req-8cc4ea26-0306-4bcf-a62a-5f2f40733156 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:44.862445 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-58b64404-5208-4b06-9430-971dd83939f6 req-8cc4ea26-0306-4bcf-a62a-5f2f40733156 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:44.876409 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-58b64404-5208-4b06-9430-971dd83939f6 req-8cc4ea26-0306-4bcf-a62a-5f2f40733156 service nova] Creating event network-vif-deleted:43edbf74-9e3b-4e8e-9196-d531a42a98a9 for instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb on hv-cinder-83699 May 23 10:52:44.882800 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-58b64404-5208-4b06-9430-971dd83939f6 req-8cc4ea26-0306-4bcf-a62a-5f2f40733156 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039375 May 23 10:52:44.883583 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 83/162] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:52:45.768609 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3ffd8ea9-4677-4e31-8898-cd13f8035262 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:45.770274 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3ffd8ea9-4677-4e31-8898-cd13f8035262 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:45.776626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ea9-4677-4e31-8898-cd13f8035262 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:45.777077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ea9-4677-4e31-8898-cd13f8035262 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:45.777841 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ea9-4677-4e31-8898-cd13f8035262 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:45.778335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ea9-4677-4e31-8898-cd13f8035262 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:45.840621 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3ffd8ea9-4677-4e31-8898-cd13f8035262 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:45.849128 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3ffd8ea9-4677-4e31-8898-cd13f8035262 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1510 microversion: 2.1 time: 0.084678 May 23 10:52:45.849689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 80/163] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:45 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:46.866862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-eed5f2cd-4565-475a-8dc4-3258605e5b01 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:46.867547 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-eed5f2cd-4565-475a-8dc4-3258605e5b01 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:46.873715 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eed5f2cd-4565-475a-8dc4-3258605e5b01 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:46.874192 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eed5f2cd-4565-475a-8dc4-3258605e5b01 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:46.874943 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eed5f2cd-4565-475a-8dc4-3258605e5b01 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:46.875375 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eed5f2cd-4565-475a-8dc4-3258605e5b01 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:46.934974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-eed5f2cd-4565-475a-8dc4-3258605e5b01 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:46.942799 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-eed5f2cd-4565-475a-8dc4-3258605e5b01 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1345 microversion: 2.1 time: 0.080776 May 23 10:52:46.943351 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 84/164] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:46 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:47.959625 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c1c493e1-f35c-4795-b0e7-ce21f8fbc655 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:47.960276 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c1c493e1-f35c-4795-b0e7-ce21f8fbc655 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:47.966849 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c1c493e1-f35c-4795-b0e7-ce21f8fbc655 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:47.967291 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c1c493e1-f35c-4795-b0e7-ce21f8fbc655 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:47.968042 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c1c493e1-f35c-4795-b0e7-ce21f8fbc655 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:47.968473 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c1c493e1-f35c-4795-b0e7-ce21f8fbc655 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:48.029129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c1c493e1-f35c-4795-b0e7-ce21f8fbc655 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61e9897f8e4c8ab2fd8cd6b5244ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d35cdfa73449c2bd040f966d9f27a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:52:48.037984 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c1c493e1-f35c-4795-b0e7-ce21f8fbc655 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 200 len: 1345 microversion: 2.1 time: 0.083266 May 23 10:52:48.038549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 81/165] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:47 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:52:49.056763 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8c17c97c-c26c-4453-a3d6-0b543a5acc74 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:49.057370 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-8c17c97c-c26c-4453-a3d6-0b543a5acc74 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:49.064161 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8c17c97c-c26c-4453-a3d6-0b543a5acc74 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:49.064817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8c17c97c-c26c-4453-a3d6-0b543a5acc74 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:49.065597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8c17c97c-c26c-4453-a3d6-0b543a5acc74 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:49.066066 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8c17c97c-c26c-4453-a3d6-0b543a5acc74 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:49.079962 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-8c17c97c-c26c-4453-a3d6-0b543a5acc74 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] HTTP exception thrown: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8c17c97c-c26c-4453-a3d6-0b543a5acc74 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Request method failure captured: May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb HTTP/1.1 May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2c6Yb5n0Fnn7nSLW70TeaDhZg2NBok9niScmFTy0WuKasiLgVCAcIb7fNGB3UwLr7q6UKUqGvXC9u144NeEtK2cOtZaFnhrAvWywSncvt96-YuDbY-RymSMt7PCOZb1xg1HWOdAq1ziBNGuFPP1nHBx1yL5_2niEPkOnBpF1-zwuhM May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: e1d35cdfa73449c2bd040f966d9f27a2 May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-DeleteServersTestJSON-882206057 May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:52:49.084623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1d35cdfa73449c2bd040f966d9f27a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-DeleteServersTestJSON-882206057 May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: e1d35cdfa73449c2bd040f966d9f27a2 May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-DeleteServersTestJSON-882206057 May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-DeleteServersTestJSON-882206057-project May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 4b61e9897f8e4c8ab2fd8cd6b5244ca5 May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-DeleteServersTestJSON-882206057-project May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:49.085845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '91a4d1f8-ff32-41e3-93ec-425c2fbabedb'} May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:52:49.086595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:49.087744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:52:49.089632 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8c17c97c-c26c-4453-a3d6-0b543a5acc74 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Returning 404 to user: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:52:49.089632 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-8c17c97c-c26c-4453-a3d6-0b543a5acc74 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 404 len: 111 microversion: 2.1 time: 0.034278 May 23 10:52:49.089632 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 85/166] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:49 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:52:49.205173 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-49e9220d-b774-4afd-b797-34045a7d8ad1 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:49.206150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-49e9220d-b774-4afd-b797-34045a7d8ad1 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:49.213120 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49e9220d-b774-4afd-b797-34045a7d8ad1 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:49.213578 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49e9220d-b774-4afd-b797-34045a7d8ad1 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:49.214385 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49e9220d-b774-4afd-b797-34045a7d8ad1 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:49.214829 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49e9220d-b774-4afd-b797-34045a7d8ad1 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:49.229701 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-49e9220d-b774-4afd-b797-34045a7d8ad1 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] HTTP exception thrown: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-49e9220d-b774-4afd-b797-34045a7d8ad1 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Request method failure captured: May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb/os-volume_attachments HTTP/1.1 May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2c6Yb5n0Fnn7nSLW70TeaDhZg2NBok9niScmFTy0WuKasiLgVCAcIb7fNGB3UwLr7q6UKUqGvXC9u144NeEtK2cOtZaFnhrAvWywSncvt96-YuDbY-RymSMt7PCOZb1xg1HWOdAq1ziBNGuFPP1nHBx1yL5_2niEPkOnBpF1-zwuhM May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: e1d35cdfa73449c2bd040f966d9f27a2 May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-DeleteServersTestJSON-882206057 May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:52:49.238059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1d35cdfa73449c2bd040f966d9f27a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-DeleteServersTestJSON-882206057 May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: e1d35cdfa73449c2bd040f966d9f27a2 May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-DeleteServersTestJSON-882206057 May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-DeleteServersTestJSON-882206057-project May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 4b61e9897f8e4c8ab2fd8cd6b5244ca5 May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-DeleteServersTestJSON-882206057-project May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:49.240167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'server_id': '91a4d1f8-ff32-41e3-93ec-425c2fbabedb'} May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:52:49.240883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:49.242119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:52:49.244241 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-49e9220d-b774-4afd-b797-34045a7d8ad1 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Returning 404 to user: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:52:49.245253 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-49e9220d-b774-4afd-b797-34045a7d8ad1 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046688 May 23 10:52:49.245850 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 82/167] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:52:49 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:52:50.470985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-32ff4770-f5cf-446e-b7f3-1770c560b954 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:50.471469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-32ff4770-f5cf-446e-b7f3-1770c560b954 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:50.479431 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-32ff4770-f5cf-446e-b7f3-1770c560b954 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:50.480132 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-32ff4770-f5cf-446e-b7f3-1770c560b954 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:50.481111 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-32ff4770-f5cf-446e-b7f3-1770c560b954 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:50.481705 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-32ff4770-f5cf-446e-b7f3-1770c560b954 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:50.504343 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-32ff4770-f5cf-446e-b7f3-1770c560b954 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] HTTP exception thrown: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-32ff4770-f5cf-446e-b7f3-1770c560b954 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Request method failure captured: May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb HTTP/1.1 May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2c6Yb5n0Fnn7nSLW70TeaDhZg2NBok9niScmFTy0WuKasiLgVCAcIb7fNGB3UwLr7q6UKUqGvXC9u144NeEtK2cOtZaFnhrAvWywSncvt96-YuDbY-RymSMt7PCOZb1xg1HWOdAq1ziBNGuFPP1nHBx1yL5_2niEPkOnBpF1-zwuhM May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: e1d35cdfa73449c2bd040f966d9f27a2 May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-DeleteServersTestJSON-882206057 May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:52:50.506541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1d35cdfa73449c2bd040f966d9f27a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-DeleteServersTestJSON-882206057 May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: e1d35cdfa73449c2bd040f966d9f27a2 May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-DeleteServersTestJSON-882206057 May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-DeleteServersTestJSON-882206057-project May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 4b61e9897f8e4c8ab2fd8cd6b5244ca5 May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-DeleteServersTestJSON-882206057-project May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:50.507668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '91a4d1f8-ff32-41e3-93ec-425c2fbabedb'} May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:52:50.508320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:50.509336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:52:50.512387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-32ff4770-f5cf-446e-b7f3-1770c560b954 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Returning 404 to user: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:52:50.513478 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-32ff4770-f5cf-446e-b7f3-1770c560b954 tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "DELETE /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 404 len: 111 microversion: 2.1 time: 0.047471 May 23 10:52:50.514666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 86/168] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:52:50 2022] DELETE /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 10:52:50.529471 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f2e24c45-4641-4da5-9aec-2b33dd47e4ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:52:50.530141 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f2e24c45-4641-4da5-9aec-2b33dd47e4ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] [instance: 91a4d1f8-ff32-41e3-93ec-425c2fbabedb] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:52:50.536985 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f2e24c45-4641-4da5-9aec-2b33dd47e4ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:50.537503 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f2e24c45-4641-4da5-9aec-2b33dd47e4ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:50.538614 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f2e24c45-4641-4da5-9aec-2b33dd47e4ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:52:50.539750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f2e24c45-4641-4da5-9aec-2b33dd47e4ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:52:50.563956 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-f2e24c45-4641-4da5-9aec-2b33dd47e4ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] HTTP exception thrown: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f2e24c45-4641-4da5-9aec-2b33dd47e4ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Request method failure captured: May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb HTTP/1.1 May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2c6Yb5n0Fnn7nSLW70TeaDhZg2NBok9niScmFTy0WuKasiLgVCAcIb7fNGB3UwLr7q6UKUqGvXC9u144NeEtK2cOtZaFnhrAvWywSncvt96-YuDbY-RymSMt7PCOZb1xg1HWOdAq1ziBNGuFPP1nHBx1yL5_2niEPkOnBpF1-zwuhM May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: e1d35cdfa73449c2bd040f966d9f27a2 May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-DeleteServersTestJSON-882206057 May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:52:50.566958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1d35cdfa73449c2bd040f966d9f27a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1d35cdfa73449c2bd040f966d9f27a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-DeleteServersTestJSON-882206057 May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: e1d35cdfa73449c2bd040f966d9f27a2 May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-DeleteServersTestJSON-882206057 May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-DeleteServersTestJSON-882206057-project May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 4b61e9897f8e4c8ab2fd8cd6b5244ca5 May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-DeleteServersTestJSON-882206057-project May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:50.568696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': '91a4d1f8-ff32-41e3-93ec-425c2fbabedb'} May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:52:50.569336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. May 23 10:52:50.571494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:52:50.572505 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f2e24c45-4641-4da5-9aec-2b33dd47e4ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] Returning 404 to user: Instance 91a4d1f8-ff32-41e3-93ec-425c2fbabedb could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:52:50.572505 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f2e24c45-4641-4da5-9aec-2b33dd47e4ef tempest-DeleteServersTestJSON-882206057 tempest-DeleteServersTestJSON-882206057-project] 10.222.0.36 "GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb" status: 404 len: 111 microversion: 2.1 time: 0.044678 May 23 10:52:50.572505 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 83/169] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:52:50 2022] GET /compute/v2.1/servers/91a4d1f8-ff32-41e3-93ec-425c2fbabedb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:53:00.241905 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1258077919", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:00.296123 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] validate_networks() for [('caad92d4-19b0-45f9-b915-72876566d29c', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:53:00.504130 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:00.741369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:53:00.741885 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:53:00.742745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:53:00.743159 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:53:00.743570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:53:00.765419 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:00.765867 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:00.768877 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:00.769388 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:00.824489 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Getting quotas for project 33781de828264846b90b5cbbbeee7fe5. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:53:00.829030 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Getting quotas for user 06f644c1c44d4dafacbd5bbdde323ff0 and project 33781de828264846b90b5cbbbeee7fe5. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:53:00.842889 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:53:00.845432 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:53:00.902305 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3f8a76c2-b44e-4538-a844-5f250f84c032 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.967437 May 23 10:53:00.903466 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 87/170] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:52:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:53:00.914062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8105019a-0aa3-442a-a458-14d0fd74fd33 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:00.914581 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8105019a-0aa3-442a-a458-14d0fd74fd33 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:00.921482 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=11 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:00.922470 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=51 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:00.996912 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8105019a-0aa3-442a-a458-14d0fd74fd33 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:01.006263 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8105019a-0aa3-442a-a458-14d0fd74fd33 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1222 microversion: 2.1 time: 0.095702 May 23 10:53:01.019603 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 84/171] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:00 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:01.166256 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-349364427", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:01.229484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] validate_networks() for [('caad92d4-19b0-45f9-b915-72876566d29c', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:53:02.134729 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:53:02.135332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:53:02.135632 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:53:02.136033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:53:02.136442 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:53:02.148440 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:02.149975 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:02.151039 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:02.151717 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:02.217147 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Getting quotas for project 33781de828264846b90b5cbbbeee7fe5. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:53:02.222212 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Getting quotas for user 06f644c1c44d4dafacbd5bbdde323ff0 and project 33781de828264846b90b5cbbbeee7fe5. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:53:02.256840 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:53:02.260233 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:53:02.336855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-86adbb03-752e-429b-9b03-da7cc86d0da3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.176534 May 23 10:53:02.337503 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 88/172] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:53:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:53:02.348461 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-543a9a76-5a94-4a8a-a2a6-0c93269c6f83 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:02.349722 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-543a9a76-5a94-4a8a-a2a6-0c93269c6f83 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:02.460474 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-543a9a76-5a94-4a8a-a2a6-0c93269c6f83 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:02.474183 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-543a9a76-5a94-4a8a-a2a6-0c93269c6f83 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1221 microversion: 2.1 time: 0.129639 May 23 10:53:02.475439 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 85/173] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:02 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:03.491820 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bfb68f4a-a755-4498-9dfc-d86dc9aadb0e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:03.492618 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bfb68f4a-a755-4498-9dfc-d86dc9aadb0e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:03.499765 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfb68f4a-a755-4498-9dfc-d86dc9aadb0e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:03.500209 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfb68f4a-a755-4498-9dfc-d86dc9aadb0e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:03.501525 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfb68f4a-a755-4498-9dfc-d86dc9aadb0e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:03.502411 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfb68f4a-a755-4498-9dfc-d86dc9aadb0e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:03.580768 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bfb68f4a-a755-4498-9dfc-d86dc9aadb0e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:03.595603 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bfb68f4a-a755-4498-9dfc-d86dc9aadb0e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1225 microversion: 2.1 time: 0.108224 May 23 10:53:03.596719 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 89/174] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:03 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:04.612591 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bff4ecf5-e9a1-42b7-8a86-9ca1202aa8f0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:04.613141 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-bff4ecf5-e9a1-42b7-8a86-9ca1202aa8f0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:04.620364 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bff4ecf5-e9a1-42b7-8a86-9ca1202aa8f0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:04.620870 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bff4ecf5-e9a1-42b7-8a86-9ca1202aa8f0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:04.621678 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bff4ecf5-e9a1-42b7-8a86-9ca1202aa8f0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:04.622309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bff4ecf5-e9a1-42b7-8a86-9ca1202aa8f0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:04.688217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-bff4ecf5-e9a1-42b7-8a86-9ca1202aa8f0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:04.695786 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-bff4ecf5-e9a1-42b7-8a86-9ca1202aa8f0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1225 microversion: 2.1 time: 0.087028 May 23 10:53:04.696671 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 86/175] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:04 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:05.713303 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5595de92-065b-4d25-b10d-cd2f5bc43fb5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:05.713900 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5595de92-065b-4d25-b10d-cd2f5bc43fb5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:05.720110 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5595de92-065b-4d25-b10d-cd2f5bc43fb5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:05.720571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5595de92-065b-4d25-b10d-cd2f5bc43fb5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:05.721525 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5595de92-065b-4d25-b10d-cd2f5bc43fb5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:05.722149 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5595de92-065b-4d25-b10d-cd2f5bc43fb5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:05.796772 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5595de92-065b-4d25-b10d-cd2f5bc43fb5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:05.805294 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5595de92-065b-4d25-b10d-cd2f5bc43fb5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1273 microversion: 2.1 time: 0.095880 May 23 10:53:05.805832 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 90/176] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:05 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:05.839575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-86dfded8-652a-44b2-af59-fa8bd5320db8 req-a4e1ef19-9ed5-432f-b060-83106095ba18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05d0a5e-e6bc-4234-b354-9792304bc88b", "tag": "4ed45538-1b79-4cff-b740-d10665911054"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:05.852418 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-86dfded8-652a-44b2-af59-fa8bd5320db8 req-a4e1ef19-9ed5-432f-b060-83106095ba18 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:05.855718 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-86dfded8-652a-44b2-af59-fa8bd5320db8 req-a4e1ef19-9ed5-432f-b060-83106095ba18 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:05.871043 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-86dfded8-652a-44b2-af59-fa8bd5320db8 req-a4e1ef19-9ed5-432f-b060-83106095ba18 service nova] Creating event network-changed:4ed45538-1b79-4cff-b740-d10665911054 for instance d05d0a5e-e6bc-4234-b354-9792304bc88b on hv-cinder-83699 May 23 10:53:05.891207 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-86dfded8-652a-44b2-af59-fa8bd5320db8 req-a4e1ef19-9ed5-432f-b060-83106095ba18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056615 May 23 10:53:05.895897 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 87/177] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:06.824347 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ddd38587-3e95-4368-865b-4f66efa5f726 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:06.824860 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ddd38587-3e95-4368-865b-4f66efa5f726 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:06.832088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ddd38587-3e95-4368-865b-4f66efa5f726 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:06.832570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ddd38587-3e95-4368-865b-4f66efa5f726 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:06.833548 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ddd38587-3e95-4368-865b-4f66efa5f726 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:06.834001 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ddd38587-3e95-4368-865b-4f66efa5f726 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:06.975711 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ddd38587-3e95-4368-865b-4f66efa5f726 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:06.986801 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ddd38587-3e95-4368-865b-4f66efa5f726 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.165227 May 23 10:53:06.987622 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 91/178] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:06 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:08.005995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0194eb88-df74-4cbf-a06f-68999d6b290c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:08.006701 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0194eb88-df74-4cbf-a06f-68999d6b290c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:08.013279 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0194eb88-df74-4cbf-a06f-68999d6b290c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:08.013860 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0194eb88-df74-4cbf-a06f-68999d6b290c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:08.014662 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0194eb88-df74-4cbf-a06f-68999d6b290c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:08.015200 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0194eb88-df74-4cbf-a06f-68999d6b290c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:08.148622 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0194eb88-df74-4cbf-a06f-68999d6b290c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:08.156125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0194eb88-df74-4cbf-a06f-68999d6b290c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.155316 May 23 10:53:08.157070 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 88/179] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:07 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:09.172575 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e315d3e2-2818-439d-831e-93c2d53c5b41 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:09.173178 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e315d3e2-2818-439d-831e-93c2d53c5b41 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:09.179843 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e315d3e2-2818-439d-831e-93c2d53c5b41 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:09.180239 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e315d3e2-2818-439d-831e-93c2d53c5b41 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:09.180999 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e315d3e2-2818-439d-831e-93c2d53c5b41 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:09.181441 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e315d3e2-2818-439d-831e-93c2d53c5b41 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:09.307863 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e315d3e2-2818-439d-831e-93c2d53c5b41 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:09.315203 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e315d3e2-2818-439d-831e-93c2d53c5b41 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.146501 May 23 10:53:09.315769 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 92/180] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:09 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:10.331564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c3840dbb-6fec-4184-b933-744855dbfd47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:10.332313 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c3840dbb-6fec-4184-b933-744855dbfd47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:10.338905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c3840dbb-6fec-4184-b933-744855dbfd47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:10.339356 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c3840dbb-6fec-4184-b933-744855dbfd47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:10.340130 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c3840dbb-6fec-4184-b933-744855dbfd47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:10.340564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c3840dbb-6fec-4184-b933-744855dbfd47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:10.558219 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c3840dbb-6fec-4184-b933-744855dbfd47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:10.574411 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c3840dbb-6fec-4184-b933-744855dbfd47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.247019 May 23 10:53:10.576513 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 89/181] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:10 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:11.065880 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-23a8707c-7be8-4374-b23e-cf4d6dce2ee5 req-254674f6-b09c-4146-8011-0cdabcb297ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8a09be-7c50-4fab-959e-164a1f0cfea3", "tag": "6a9500e0-dd8b-4edc-8fb4-383677d888e0"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:11.090299 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-23a8707c-7be8-4374-b23e-cf4d6dce2ee5 req-254674f6-b09c-4146-8011-0cdabcb297ea service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:11.090755 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-23a8707c-7be8-4374-b23e-cf4d6dce2ee5 req-254674f6-b09c-4146-8011-0cdabcb297ea service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:11.104979 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-23a8707c-7be8-4374-b23e-cf4d6dce2ee5 req-254674f6-b09c-4146-8011-0cdabcb297ea service nova] Creating event network-changed:6a9500e0-dd8b-4edc-8fb4-383677d888e0 for instance df8a09be-7c50-4fab-959e-164a1f0cfea3 on hv-cinder-83699 May 23 10:53:11.110314 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-23a8707c-7be8-4374-b23e-cf4d6dce2ee5 req-254674f6-b09c-4146-8011-0cdabcb297ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049448 May 23 10:53:11.110915 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 93/182] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:11.592321 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4da0bcf1-bcc6-48fc-a99b-c56d0042a488 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:11.592991 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4da0bcf1-bcc6-48fc-a99b-c56d0042a488 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:11.600304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4da0bcf1-bcc6-48fc-a99b-c56d0042a488 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:11.600841 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4da0bcf1-bcc6-48fc-a99b-c56d0042a488 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:11.601754 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4da0bcf1-bcc6-48fc-a99b-c56d0042a488 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:11.602328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4da0bcf1-bcc6-48fc-a99b-c56d0042a488 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:11.741555 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4da0bcf1-bcc6-48fc-a99b-c56d0042a488 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:11.749502 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4da0bcf1-bcc6-48fc-a99b-c56d0042a488 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.161229 May 23 10:53:11.750559 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 90/183] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:11 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:12.080645 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-0bcde470-65ff-4e58-9ce5-8d662b6bdc39 req-aed2baca-8426-4b5f-8aeb-c87d26d098da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05d0a5e-e6bc-4234-b354-9792304bc88b", "name": "network-vif-plugged", "status": "completed", "tag": "4ed45538-1b79-4cff-b740-d10665911054"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:12.084842 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:12.092370 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-0bcde470-65ff-4e58-9ce5-8d662b6bdc39 req-aed2baca-8426-4b5f-8aeb-c87d26d098da service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:12.092825 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-0bcde470-65ff-4e58-9ce5-8d662b6bdc39 req-aed2baca-8426-4b5f-8aeb-c87d26d098da service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:12.105359 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-0bcde470-65ff-4e58-9ce5-8d662b6bdc39 req-aed2baca-8426-4b5f-8aeb-c87d26d098da service nova] Creating event network-vif-plugged:4ed45538-1b79-4cff-b740-d10665911054 for instance d05d0a5e-e6bc-4234-b354-9792304bc88b on hv-cinder-83699 May 23 10:53:12.110177 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-0bcde470-65ff-4e58-9ce5-8d662b6bdc39 req-aed2baca-8426-4b5f-8aeb-c87d26d098da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033628 May 23 10:53:12.111306 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 94/184] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:12.766467 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-156710a8-57d4-421b-9821-ad0af0252ca5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:12.767492 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-156710a8-57d4-421b-9821-ad0af0252ca5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:12.771170 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=4 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:12.781688 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-156710a8-57d4-421b-9821-ad0af0252ca5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:12.781688 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-156710a8-57d4-421b-9821-ad0af0252ca5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:12.781688 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-156710a8-57d4-421b-9821-ad0af0252ca5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:12.781688 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-156710a8-57d4-421b-9821-ad0af0252ca5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:12.916192 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-156710a8-57d4-421b-9821-ad0af0252ca5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:12.923635 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-156710a8-57d4-421b-9821-ad0af0252ca5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.161343 May 23 10:53:12.924281 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 91/185] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:12 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:13.058194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=4 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:13.058965 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=12 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:13.063273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a9157261-d6cf-479d-b64a-601cfcc0a90b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:13.063856 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a9157261-d6cf-479d-b64a-601cfcc0a90b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:13.071658 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9157261-d6cf-479d-b64a-601cfcc0a90b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:13.072113 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9157261-d6cf-479d-b64a-601cfcc0a90b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:13.072882 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9157261-d6cf-479d-b64a-601cfcc0a90b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:13.073321 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9157261-d6cf-479d-b64a-601cfcc0a90b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:13.095601 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a9157261-d6cf-479d-b64a-601cfcc0a90b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/ips" status: 200 len: 146 microversion: 2.1 time: 0.038280 May 23 10:53:13.096157 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 95/186] 10.222.0.36 () {58 vars in 1247 bytes} [Mon May 23 10:53:13 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:13.940857 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bf8b8ea0-88a9-4c51-8867-af7895caf84a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:13.941508 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-bf8b8ea0-88a9-4c51-8867-af7895caf84a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:13.948573 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bf8b8ea0-88a9-4c51-8867-af7895caf84a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:13.949025 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bf8b8ea0-88a9-4c51-8867-af7895caf84a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:13.949797 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bf8b8ea0-88a9-4c51-8867-af7895caf84a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:13.950261 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bf8b8ea0-88a9-4c51-8867-af7895caf84a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:14.081645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-bf8b8ea0-88a9-4c51-8867-af7895caf84a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:14.090457 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-bf8b8ea0-88a9-4c51-8867-af7895caf84a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.153672 May 23 10:53:14.091040 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 92/187] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:13 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:14.803663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a94854b1-7090-4338-ad8d-0d33b8d5eb84 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:14.804180 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a94854b1-7090-4338-ad8d-0d33b8d5eb84 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:14.810190 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a94854b1-7090-4338-ad8d-0d33b8d5eb84 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:14.810633 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a94854b1-7090-4338-ad8d-0d33b8d5eb84 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:14.811380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a94854b1-7090-4338-ad8d-0d33b8d5eb84 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:14.811808 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a94854b1-7090-4338-ad8d-0d33b8d5eb84 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:14.833913 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a94854b1-7090-4338-ad8d-0d33b8d5eb84 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/ips" status: 200 len: 153 microversion: 2.20 time: 0.034182 May 23 10:53:14.834492 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 96/188] 10.222.0.36 () {60 vars in 1288 bytes} [Mon May 23 10:53:14 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/ips => generated 153 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:53:15.107066 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b9ea2ec9-7ff0-4cab-926b-69a83376f338 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:15.107672 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b9ea2ec9-7ff0-4cab-926b-69a83376f338 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:15.114914 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b9ea2ec9-7ff0-4cab-926b-69a83376f338 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:15.115626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b9ea2ec9-7ff0-4cab-926b-69a83376f338 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:15.116402 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b9ea2ec9-7ff0-4cab-926b-69a83376f338 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:15.116842 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b9ea2ec9-7ff0-4cab-926b-69a83376f338 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:15.257114 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b9ea2ec9-7ff0-4cab-926b-69a83376f338 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:15.265102 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b9ea2ec9-7ff0-4cab-926b-69a83376f338 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.161816 May 23 10:53:15.265764 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 93/189] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:15 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:16.282121 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-77455568-5df2-459d-ae34-c6da56206bb6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:16.282733 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-77455568-5df2-459d-ae34-c6da56206bb6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:16.289328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77455568-5df2-459d-ae34-c6da56206bb6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:16.289780 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77455568-5df2-459d-ae34-c6da56206bb6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:16.292964 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77455568-5df2-459d-ae34-c6da56206bb6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:16.292964 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77455568-5df2-459d-ae34-c6da56206bb6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:16.328909 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d0f89413-8e78-4838-b580-38011ca1de00 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02657450-370c-4639-9fe2-2277d4bc507f"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:16.329982 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d0f89413-8e78-4838-b580-38011ca1de00 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:16.336742 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0f89413-8e78-4838-b580-38011ca1de00 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:16.337242 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0f89413-8e78-4838-b580-38011ca1de00 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:16.338027 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0f89413-8e78-4838-b580-38011ca1de00 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:16.338438 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0f89413-8e78-4838-b580-38011ca1de00 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:16.481826 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-77455568-5df2-459d-ae34-c6da56206bb6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:16.489984 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-77455568-5df2-459d-ae34-c6da56206bb6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.211582 May 23 10:53:16.490930 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 97/190] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:16 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:16.673835 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d0f89413-8e78-4838-b580-38011ca1de00 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348666 May 23 10:53:16.674581 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 94/191] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:53:16 2022] POST /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:53:17.506470 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-92cf304d-64ca-4f61-9b3f-a983013ec4cd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:17.507071 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-92cf304d-64ca-4f61-9b3f-a983013ec4cd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:17.512986 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-92cf304d-64ca-4f61-9b3f-a983013ec4cd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:17.513427 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-92cf304d-64ca-4f61-9b3f-a983013ec4cd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:17.514210 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-92cf304d-64ca-4f61-9b3f-a983013ec4cd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:17.514643 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-92cf304d-64ca-4f61-9b3f-a983013ec4cd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:17.640260 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-92cf304d-64ca-4f61-9b3f-a983013ec4cd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:17.648166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-92cf304d-64ca-4f61-9b3f-a983013ec4cd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.145643 May 23 10:53:17.648737 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 98/192] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:17 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:17.731310 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6c62961b-835e-4175-a42e-77b3f158a6d7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:17.731862 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6c62961b-835e-4175-a42e-77b3f158a6d7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:17.738101 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6c62961b-835e-4175-a42e-77b3f158a6d7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:17.739111 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6c62961b-835e-4175-a42e-77b3f158a6d7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:17.739876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6c62961b-835e-4175-a42e-77b3f158a6d7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:17.740308 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6c62961b-835e-4175-a42e-77b3f158a6d7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:17.762389 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-6c62961b-835e-4175-a42e-77b3f158a6d7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lazy-loading 'flavor' on Instance uuid 1e61941d-0058-4809-83b9-676d70df112a {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:53:18.061575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6c62961b-835e-4175-a42e-77b3f158a6d7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "POST /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/action" status: 202 len: 0 microversion: 2.20 time: 0.334939 May 23 10:53:18.062242 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 95/193] 10.222.0.36 () {62 vars in 1318 bytes} [Mon May 23 10:53:17 2022] POST /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 10:53:18.070455 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-68bb6a84-2543-4dae-9b71-850dcfd8b5eb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:18.071055 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-68bb6a84-2543-4dae-9b71-850dcfd8b5eb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:18.077061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-68bb6a84-2543-4dae-9b71-850dcfd8b5eb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:18.077510 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-68bb6a84-2543-4dae-9b71-850dcfd8b5eb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:18.078302 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-68bb6a84-2543-4dae-9b71-850dcfd8b5eb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:18.078735 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-68bb6a84-2543-4dae-9b71-850dcfd8b5eb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:18.204961 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-68bb6a84-2543-4dae-9b71-850dcfd8b5eb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:18.213370 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-68bb6a84-2543-4dae-9b71-850dcfd8b5eb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:18.214885 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-68bb6a84-2543-4dae-9b71-850dcfd8b5eb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:18.216307 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-68bb6a84-2543-4dae-9b71-850dcfd8b5eb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.149610 May 23 10:53:18.216716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 99/194] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:18 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:18.665605 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a116ba64-1caa-4adf-aa88-52825d0f28fa tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:18.666348 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a116ba64-1caa-4adf-aa88-52825d0f28fa tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:18.672682 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a116ba64-1caa-4adf-aa88-52825d0f28fa tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:18.673165 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a116ba64-1caa-4adf-aa88-52825d0f28fa tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:18.673944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a116ba64-1caa-4adf-aa88-52825d0f28fa tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:18.674408 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a116ba64-1caa-4adf-aa88-52825d0f28fa tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:18.801502 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a116ba64-1caa-4adf-aa88-52825d0f28fa tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:18.809015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a116ba64-1caa-4adf-aa88-52825d0f28fa tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.148069 May 23 10:53:18.809584 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 96/195] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:18 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:19.233897 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9f52ca4d-f8e5-4800-956a-66e859400a63 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:19.234795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9f52ca4d-f8e5-4800-956a-66e859400a63 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:19.241648 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f52ca4d-f8e5-4800-956a-66e859400a63 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:19.242260 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f52ca4d-f8e5-4800-956a-66e859400a63 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:19.243247 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f52ca4d-f8e5-4800-956a-66e859400a63 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:19.243792 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f52ca4d-f8e5-4800-956a-66e859400a63 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:19.372039 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9f52ca4d-f8e5-4800-956a-66e859400a63 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:19.379865 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9f52ca4d-f8e5-4800-956a-66e859400a63 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:19.382318 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9f52ca4d-f8e5-4800-956a-66e859400a63 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:19.383510 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9f52ca4d-f8e5-4800-956a-66e859400a63 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.153384 May 23 10:53:19.385365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 100/196] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:19 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:19.827940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-aff5b16a-ca31-4fbe-8e7d-d34ca029231f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:19.831653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-aff5b16a-ca31-4fbe-8e7d-d34ca029231f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:19.840439 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aff5b16a-ca31-4fbe-8e7d-d34ca029231f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:19.841240 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aff5b16a-ca31-4fbe-8e7d-d34ca029231f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:19.842582 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aff5b16a-ca31-4fbe-8e7d-d34ca029231f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:19.843307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aff5b16a-ca31-4fbe-8e7d-d34ca029231f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:19.994462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aff5b16a-ca31-4fbe-8e7d-d34ca029231f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:20.001934 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-aff5b16a-ca31-4fbe-8e7d-d34ca029231f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.179639 May 23 10:53:20.002768 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 97/197] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:19 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:20.402346 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6f952cb1-3376-4a07-a96c-0b9685a71f17 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:20.402976 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6f952cb1-3376-4a07-a96c-0b9685a71f17 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:20.409395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f952cb1-3376-4a07-a96c-0b9685a71f17 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:20.409842 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f952cb1-3376-4a07-a96c-0b9685a71f17 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:20.411180 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f952cb1-3376-4a07-a96c-0b9685a71f17 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:20.411611 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f952cb1-3376-4a07-a96c-0b9685a71f17 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:20.540341 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6f952cb1-3376-4a07-a96c-0b9685a71f17 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:20.548141 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6f952cb1-3376-4a07-a96c-0b9685a71f17 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:20.549635 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6f952cb1-3376-4a07-a96c-0b9685a71f17 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:20.551551 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6f952cb1-3376-4a07-a96c-0b9685a71f17 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.152848 May 23 10:53:20.552105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 101/198] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:20 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:21.020396 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ca1937bb-d922-4405-9ccc-c9aca6825363 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:21.021013 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ca1937bb-d922-4405-9ccc-c9aca6825363 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:21.027558 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ca1937bb-d922-4405-9ccc-c9aca6825363 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:21.028095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ca1937bb-d922-4405-9ccc-c9aca6825363 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:21.028698 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ca1937bb-d922-4405-9ccc-c9aca6825363 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:21.029122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ca1937bb-d922-4405-9ccc-c9aca6825363 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:21.157357 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ca1937bb-d922-4405-9ccc-c9aca6825363 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:21.166630 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ca1937bb-d922-4405-9ccc-c9aca6825363 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.150204 May 23 10:53:21.167236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 98/199] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:21 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:21.574325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-021e1074-5f07-4722-bba3-6ffaa84fd843 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:21.574921 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-021e1074-5f07-4722-bba3-6ffaa84fd843 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:21.578915 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-303b9ef2-3fa8-4628-84fd-8b9b1ccf5637 req-e17362c0-ec12-4daa-b78e-e03df4124f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8a09be-7c50-4fab-959e-164a1f0cfea3", "name": "network-vif-plugged", "status": "completed", "tag": "6a9500e0-dd8b-4edc-8fb4-383677d888e0"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:21.581669 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-021e1074-5f07-4722-bba3-6ffaa84fd843 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:21.582798 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-021e1074-5f07-4722-bba3-6ffaa84fd843 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:21.583578 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-021e1074-5f07-4722-bba3-6ffaa84fd843 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:21.584255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-021e1074-5f07-4722-bba3-6ffaa84fd843 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:21.588307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-303b9ef2-3fa8-4628-84fd-8b9b1ccf5637 req-e17362c0-ec12-4daa-b78e-e03df4124f1c service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:21.588968 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-303b9ef2-3fa8-4628-84fd-8b9b1ccf5637 req-e17362c0-ec12-4daa-b78e-e03df4124f1c service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:21.602344 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-303b9ef2-3fa8-4628-84fd-8b9b1ccf5637 req-e17362c0-ec12-4daa-b78e-e03df4124f1c service nova] Creating event network-vif-plugged:6a9500e0-dd8b-4edc-8fb4-383677d888e0 for instance df8a09be-7c50-4fab-959e-164a1f0cfea3 on hv-cinder-83699 May 23 10:53:21.607979 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-303b9ef2-3fa8-4628-84fd-8b9b1ccf5637 req-e17362c0-ec12-4daa-b78e-e03df4124f1c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040549 May 23 10:53:21.609568 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 99/200] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:21.745705 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-021e1074-5f07-4722-bba3-6ffaa84fd843 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:21.754560 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-021e1074-5f07-4722-bba3-6ffaa84fd843 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:21.756063 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-021e1074-5f07-4722-bba3-6ffaa84fd843 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:21.757439 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-021e1074-5f07-4722-bba3-6ffaa84fd843 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.191183 May 23 10:53:21.758042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 102/201] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:21 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:53:22.184622 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2d58778e-71fa-4019-8b00-c8f9dfe314d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:22.185278 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2d58778e-71fa-4019-8b00-c8f9dfe314d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:22.192632 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2d58778e-71fa-4019-8b00-c8f9dfe314d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:22.193085 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2d58778e-71fa-4019-8b00-c8f9dfe314d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:22.193878 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2d58778e-71fa-4019-8b00-c8f9dfe314d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:22.194346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2d58778e-71fa-4019-8b00-c8f9dfe314d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:22.217822 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:22.341904 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2d58778e-71fa-4019-8b00-c8f9dfe314d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:22.349477 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2d58778e-71fa-4019-8b00-c8f9dfe314d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.169819 May 23 10:53:22.350087 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 100/202] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:22 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:22.777047 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-506746fd-34cb-477b-8a16-e4fa17206f05 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:22.777658 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-506746fd-34cb-477b-8a16-e4fa17206f05 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:22.783792 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-506746fd-34cb-477b-8a16-e4fa17206f05 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:22.784247 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-506746fd-34cb-477b-8a16-e4fa17206f05 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:22.785508 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-506746fd-34cb-477b-8a16-e4fa17206f05 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:22.786150 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-506746fd-34cb-477b-8a16-e4fa17206f05 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:22.917394 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-506746fd-34cb-477b-8a16-e4fa17206f05 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:22.925309 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-506746fd-34cb-477b-8a16-e4fa17206f05 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:22.927440 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-506746fd-34cb-477b-8a16-e4fa17206f05 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:22.928599 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-506746fd-34cb-477b-8a16-e4fa17206f05 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.155723 May 23 10:53:22.929395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 103/203] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:22 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:23.366138 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d645ddda-4c64-490d-aeb0-313f11342e87 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:23.367384 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d645ddda-4c64-490d-aeb0-313f11342e87 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:23.375471 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d645ddda-4c64-490d-aeb0-313f11342e87 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:23.376161 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d645ddda-4c64-490d-aeb0-313f11342e87 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:23.377152 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d645ddda-4c64-490d-aeb0-313f11342e87 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:23.377584 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d645ddda-4c64-490d-aeb0-313f11342e87 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:23.509515 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d645ddda-4c64-490d-aeb0-313f11342e87 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:23.519123 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d645ddda-4c64-490d-aeb0-313f11342e87 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1321 microversion: 2.1 time: 0.156845 May 23 10:53:23.521344 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 101/204] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:23 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:23.949823 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-663278c7-addb-41b2-b442-a4c90ea06932 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:23.951227 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-663278c7-addb-41b2-b442-a4c90ea06932 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:23.957407 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-663278c7-addb-41b2-b442-a4c90ea06932 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:23.957854 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-663278c7-addb-41b2-b442-a4c90ea06932 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:23.959097 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-663278c7-addb-41b2-b442-a4c90ea06932 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:23.959530 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-663278c7-addb-41b2-b442-a4c90ea06932 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:24.105680 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-663278c7-addb-41b2-b442-a4c90ea06932 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:24.115344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-663278c7-addb-41b2-b442-a4c90ea06932 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:24.117308 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-663278c7-addb-41b2-b442-a4c90ea06932 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:24.118526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-663278c7-addb-41b2-b442-a4c90ea06932 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.174693 May 23 10:53:24.120009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 104/205] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:23 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:24.537792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-97c7d346-4889-4294-afbd-32f4427869d0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:24.539042 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-97c7d346-4889-4294-afbd-32f4427869d0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:24.545913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97c7d346-4889-4294-afbd-32f4427869d0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:24.546652 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97c7d346-4889-4294-afbd-32f4427869d0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:24.547629 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97c7d346-4889-4294-afbd-32f4427869d0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:24.548069 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97c7d346-4889-4294-afbd-32f4427869d0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:24.693419 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-97c7d346-4889-4294-afbd-32f4427869d0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:24.704241 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-97c7d346-4889-4294-afbd-32f4427869d0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1514 microversion: 2.1 time: 0.170787 May 23 10:53:24.705216 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 102/206] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:24 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:24.722148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cc092620-6d60-4641-a56e-16ccb1f92263 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:24.724221 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-cc092620-6d60-4641-a56e-16ccb1f92263 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:24.730683 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cc092620-6d60-4641-a56e-16ccb1f92263 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:24.731151 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cc092620-6d60-4641-a56e-16ccb1f92263 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:24.732165 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cc092620-6d60-4641-a56e-16ccb1f92263 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:24.733274 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cc092620-6d60-4641-a56e-16ccb1f92263 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:24.757434 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-cc092620-6d60-4641-a56e-16ccb1f92263 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lazy-loading 'flavor' on Instance uuid df8a09be-7c50-4fab-959e-164a1f0cfea3 {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:53:24.830295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:24.877352 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-cc092620-6d60-4641-a56e-16ccb1f92263 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3/action" status: 200 len: 32 microversion: 2.1 time: 0.159508 May 23 10:53:24.878136 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 105/207] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 10:53:24 2022] POST /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 10:53:24.888154 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b0a93929-d6ae-4e00-b667-dc4b60f2874e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:24.888775 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b0a93929-d6ae-4e00-b667-dc4b60f2874e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:24.896355 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b0a93929-d6ae-4e00-b667-dc4b60f2874e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:24.896512 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b0a93929-d6ae-4e00-b667-dc4b60f2874e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:24.897694 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b0a93929-d6ae-4e00-b667-dc4b60f2874e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:24.898382 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b0a93929-d6ae-4e00-b667-dc4b60f2874e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:25.055385 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b0a93929-d6ae-4e00-b667-dc4b60f2874e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:25.064811 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b0a93929-d6ae-4e00-b667-dc4b60f2874e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.180818 May 23 10:53:25.065806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 103/208] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:24 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:25.150187 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6eaec6f2-49fe-476d-af82-1b6ad0063918 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:25.151745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6eaec6f2-49fe-476d-af82-1b6ad0063918 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:25.160674 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6eaec6f2-49fe-476d-af82-1b6ad0063918 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:25.161373 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6eaec6f2-49fe-476d-af82-1b6ad0063918 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:25.163174 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6eaec6f2-49fe-476d-af82-1b6ad0063918 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:25.164855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6eaec6f2-49fe-476d-af82-1b6ad0063918 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:25.550009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6eaec6f2-49fe-476d-af82-1b6ad0063918 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:25.558694 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6eaec6f2-49fe-476d-af82-1b6ad0063918 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:25.560346 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6eaec6f2-49fe-476d-af82-1b6ad0063918 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:25.561904 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6eaec6f2-49fe-476d-af82-1b6ad0063918 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.417763 May 23 10:53:25.573184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 106/209] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:25 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:26.083517 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-05c53d23-2b60-4567-858f-4f380f0c7abb tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:26.084185 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-05c53d23-2b60-4567-858f-4f380f0c7abb tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:26.092206 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-05c53d23-2b60-4567-858f-4f380f0c7abb tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:26.092655 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-05c53d23-2b60-4567-858f-4f380f0c7abb tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:26.093718 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-05c53d23-2b60-4567-858f-4f380f0c7abb tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:26.094390 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-05c53d23-2b60-4567-858f-4f380f0c7abb tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:26.260930 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-05c53d23-2b60-4567-858f-4f380f0c7abb tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:26.269668 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-05c53d23-2b60-4567-858f-4f380f0c7abb tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.190166 May 23 10:53:26.270587 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 104/210] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:26 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:26.580282 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-12fa6c67-0583-44d8-91f5-49c215690bc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:26.580878 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-12fa6c67-0583-44d8-91f5-49c215690bc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:26.586866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-12fa6c67-0583-44d8-91f5-49c215690bc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:26.587306 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-12fa6c67-0583-44d8-91f5-49c215690bc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:26.588064 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-12fa6c67-0583-44d8-91f5-49c215690bc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:26.588494 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-12fa6c67-0583-44d8-91f5-49c215690bc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:26.728443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-12fa6c67-0583-44d8-91f5-49c215690bc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:26.736885 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-12fa6c67-0583-44d8-91f5-49c215690bc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:26.739038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-12fa6c67-0583-44d8-91f5-49c215690bc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:26.740201 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-12fa6c67-0583-44d8-91f5-49c215690bc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.163668 May 23 10:53:26.740776 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 107/211] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:26 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:27.287183 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c6894ad4-18a2-4e8b-8bf3-67d9bcfffa78 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:27.287790 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c6894ad4-18a2-4e8b-8bf3-67d9bcfffa78 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:27.294214 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c6894ad4-18a2-4e8b-8bf3-67d9bcfffa78 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:27.294729 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c6894ad4-18a2-4e8b-8bf3-67d9bcfffa78 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:27.295493 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c6894ad4-18a2-4e8b-8bf3-67d9bcfffa78 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:27.295923 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c6894ad4-18a2-4e8b-8bf3-67d9bcfffa78 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:27.456816 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c6894ad4-18a2-4e8b-8bf3-67d9bcfffa78 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:27.465446 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c6894ad4-18a2-4e8b-8bf3-67d9bcfffa78 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.182113 May 23 10:53:27.466041 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 105/212] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:27 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:27.759795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d6fc0d32-37a0-4e37-92fb-940acc5329f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:27.760496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d6fc0d32-37a0-4e37-92fb-940acc5329f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:27.769610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6fc0d32-37a0-4e37-92fb-940acc5329f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:27.770353 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6fc0d32-37a0-4e37-92fb-940acc5329f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:27.771277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6fc0d32-37a0-4e37-92fb-940acc5329f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:27.772782 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6fc0d32-37a0-4e37-92fb-940acc5329f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:27.930480 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d6fc0d32-37a0-4e37-92fb-940acc5329f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:27.938982 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d6fc0d32-37a0-4e37-92fb-940acc5329f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:27.940483 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d6fc0d32-37a0-4e37-92fb-940acc5329f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:27.941667 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d6fc0d32-37a0-4e37-92fb-940acc5329f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.185867 May 23 10:53:27.942464 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 108/213] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:27 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:28.482995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-903f8764-244d-45c0-a20f-53f11731e654 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:28.483603 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-903f8764-244d-45c0-a20f-53f11731e654 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:28.486287 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4c8f37c7-2cb4-45ae-807f-8810e6407883 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:28.490196 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-903f8764-244d-45c0-a20f-53f11731e654 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:28.490899 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-903f8764-244d-45c0-a20f-53f11731e654 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:28.491881 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-903f8764-244d-45c0-a20f-53f11731e654 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:28.492847 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4c8f37c7-2cb4-45ae-807f-8810e6407883 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:28.492969 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-903f8764-244d-45c0-a20f-53f11731e654 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:28.493298 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4c8f37c7-2cb4-45ae-807f-8810e6407883 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:28.555307 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-4c8f37c7-2cb4-45ae-807f-8810e6407883 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Going to try to stop instance {{(pid=129029) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 10:53:28.598958 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4c8f37c7-2cb4-45ae-807f-8810e6407883 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/action" status: 202 len: 0 microversion: 2.1 time: 0.116495 May 23 10:53:28.599565 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 109/214] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 10:53:28 2022] POST /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 10:53:28.607814 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-86c6b769-d8ef-468f-bae7-9df9161b6f25 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:28.608694 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-86c6b769-d8ef-468f-bae7-9df9161b6f25 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:28.615207 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86c6b769-d8ef-468f-bae7-9df9161b6f25 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:28.615378 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86c6b769-d8ef-468f-bae7-9df9161b6f25 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:28.616159 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86c6b769-d8ef-468f-bae7-9df9161b6f25 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:28.616553 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-86c6b769-d8ef-468f-bae7-9df9161b6f25 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:28.630369 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-903f8764-244d-45c0-a20f-53f11731e654 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:28.637778 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-903f8764-244d-45c0-a20f-53f11731e654 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.159230 May 23 10:53:28.638388 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 106/215] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:28 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:28.746471 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-86c6b769-d8ef-468f-bae7-9df9161b6f25 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:28.754923 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-86c6b769-d8ef-468f-bae7-9df9161b6f25 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.151123 May 23 10:53:28.755487 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 110/216] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:28 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:28.961100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a369914a-646c-443a-955d-e6ed090c2e1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:28.961616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a369914a-646c-443a-955d-e6ed090c2e1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:28.967970 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a369914a-646c-443a-955d-e6ed090c2e1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:28.968409 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a369914a-646c-443a-955d-e6ed090c2e1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:28.969160 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a369914a-646c-443a-955d-e6ed090c2e1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:28.969596 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a369914a-646c-443a-955d-e6ed090c2e1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:29.099758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a369914a-646c-443a-955d-e6ed090c2e1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:29.108067 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a369914a-646c-443a-955d-e6ed090c2e1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:29.109560 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a369914a-646c-443a-955d-e6ed090c2e1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:29.110797 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a369914a-646c-443a-955d-e6ed090c2e1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.154202 May 23 10:53:29.111310 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 107/217] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:28 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:53:29.655402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f53d0675-74b4-4879-a499-16b42a3b1369 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:29.655997 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f53d0675-74b4-4879-a499-16b42a3b1369 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:29.662499 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f53d0675-74b4-4879-a499-16b42a3b1369 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:29.662946 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f53d0675-74b4-4879-a499-16b42a3b1369 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:29.663693 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f53d0675-74b4-4879-a499-16b42a3b1369 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:29.664120 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f53d0675-74b4-4879-a499-16b42a3b1369 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:29.773259 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9fe1735b-d3b6-49d4-84c5-3e03cc8df5be tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:29.774890 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9fe1735b-d3b6-49d4-84c5-3e03cc8df5be tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:29.781724 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9fe1735b-d3b6-49d4-84c5-3e03cc8df5be tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:29.782999 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9fe1735b-d3b6-49d4-84c5-3e03cc8df5be tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:29.783881 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9fe1735b-d3b6-49d4-84c5-3e03cc8df5be tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:29.784853 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9fe1735b-d3b6-49d4-84c5-3e03cc8df5be tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:29.812534 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f53d0675-74b4-4879-a499-16b42a3b1369 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:29.820882 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f53d0675-74b4-4879-a499-16b42a3b1369 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.169330 May 23 10:53:29.830505 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 111/218] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:29 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:29.913438 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-07f980b6-68b1-42e4-9907-f9f536996b22 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:29.914217 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-07f980b6-68b1-42e4-9907-f9f536996b22 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:29.920779 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-9fe1735b-d3b6-49d4-84c5-3e03cc8df5be tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:29.920916 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-07f980b6-68b1-42e4-9907-f9f536996b22 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:29.921413 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-07f980b6-68b1-42e4-9907-f9f536996b22 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:29.922443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-07f980b6-68b1-42e4-9907-f9f536996b22 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:29.922955 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-07f980b6-68b1-42e4-9907-f9f536996b22 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:29.928816 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9fe1735b-d3b6-49d4-84c5-3e03cc8df5be tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.160293 May 23 10:53:29.929990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 108/219] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:29 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:29.947729 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-07f980b6-68b1-42e4-9907-f9f536996b22 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/ips" status: 200 len: 150 microversion: 2.1 time: 0.038818 May 23 10:53:29.948309 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 112/220] 10.222.0.36 () {58 vars in 1247 bytes} [Mon May 23 10:53:29 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:30.130462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f57a4998-1765-464e-a21b-7040c7f3a646 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:30.131071 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f57a4998-1765-464e-a21b-7040c7f3a646 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:30.137035 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f57a4998-1765-464e-a21b-7040c7f3a646 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:30.137491 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f57a4998-1765-464e-a21b-7040c7f3a646 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:30.138292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f57a4998-1765-464e-a21b-7040c7f3a646 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:30.138741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f57a4998-1765-464e-a21b-7040c7f3a646 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:30.296741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f57a4998-1765-464e-a21b-7040c7f3a646 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:30.306015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f57a4998-1765-464e-a21b-7040c7f3a646 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:30.307510 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f57a4998-1765-464e-a21b-7040c7f3a646 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:30.308677 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f57a4998-1765-464e-a21b-7040c7f3a646 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.182732 May 23 10:53:30.309252 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 109/221] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:30 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:53:30.837534 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-eafaf502-c73d-4dfa-996c-f0947a71cd82 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:30.838176 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-eafaf502-c73d-4dfa-996c-f0947a71cd82 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:30.844197 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eafaf502-c73d-4dfa-996c-f0947a71cd82 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:30.844644 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eafaf502-c73d-4dfa-996c-f0947a71cd82 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:30.845402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eafaf502-c73d-4dfa-996c-f0947a71cd82 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:30.845838 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eafaf502-c73d-4dfa-996c-f0947a71cd82 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:30.945997 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-dbc447e1-83e3-4069-96a2-2a46cbbbf022 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:30.946613 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-dbc447e1-83e3-4069-96a2-2a46cbbbf022 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:30.953024 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dbc447e1-83e3-4069-96a2-2a46cbbbf022 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:30.953473 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dbc447e1-83e3-4069-96a2-2a46cbbbf022 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:30.954267 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dbc447e1-83e3-4069-96a2-2a46cbbbf022 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:30.954705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dbc447e1-83e3-4069-96a2-2a46cbbbf022 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:30.971111 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-eafaf502-c73d-4dfa-996c-f0947a71cd82 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:30.978946 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-eafaf502-c73d-4dfa-996c-f0947a71cd82 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.145255 May 23 10:53:30.986459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 113/222] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:30 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:31.079780 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-dbc447e1-83e3-4069-96a2-2a46cbbbf022 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:31.087673 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-dbc447e1-83e3-4069-96a2-2a46cbbbf022 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.145468 May 23 10:53:31.088280 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 110/223] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:30 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:31.317355 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-238eca65-ff20-4932-83f8-463d40edac63 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e81aa104-d691-465f-8d99-90e7d630f035"}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:31.318559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-238eca65-ff20-4932-83f8-463d40edac63 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:31.324897 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-238eca65-ff20-4932-83f8-463d40edac63 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:31.325465 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-238eca65-ff20-4932-83f8-463d40edac63 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:31.326273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-238eca65-ff20-4932-83f8-463d40edac63 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:31.326773 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-238eca65-ff20-4932-83f8-463d40edac63 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:31.327853 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2935ae31-9fd4-4da5-86a5-3ae770dd8f31 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:31.328540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2935ae31-9fd4-4da5-86a5-3ae770dd8f31 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:31.331452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=59 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:31.335715 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2935ae31-9fd4-4da5-86a5-3ae770dd8f31 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:31.336246 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2935ae31-9fd4-4da5-86a5-3ae770dd8f31 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:31.337305 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2935ae31-9fd4-4da5-86a5-3ae770dd8f31 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:31.337816 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2935ae31-9fd4-4da5-86a5-3ae770dd8f31 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:31.482779 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2935ae31-9fd4-4da5-86a5-3ae770dd8f31 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:31.493700 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2935ae31-9fd4-4da5-86a5-3ae770dd8f31 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:31.495267 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2935ae31-9fd4-4da5-86a5-3ae770dd8f31 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:31.496429 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2935ae31-9fd4-4da5-86a5-3ae770dd8f31 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1743 microversion: 2.20 time: 0.172877 May 23 10:53:31.496999 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 111/224] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:31 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:31.656879 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-238eca65-ff20-4932-83f8-463d40edac63 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343375 May 23 10:53:31.658104 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 114/225] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:53:31 2022] POST /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:31.995940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b459a1dd-9495-4e27-8844-778581eea0a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:31.996542 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b459a1dd-9495-4e27-8844-778581eea0a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:32.003077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b459a1dd-9495-4e27-8844-778581eea0a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:32.003556 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b459a1dd-9495-4e27-8844-778581eea0a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:32.004327 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b459a1dd-9495-4e27-8844-778581eea0a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:32.005374 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b459a1dd-9495-4e27-8844-778581eea0a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:32.105118 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b163218e-b534-4068-a3c6-19a7120f1a0c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:32.105885 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b163218e-b534-4068-a3c6-19a7120f1a0c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:32.112610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b163218e-b534-4068-a3c6-19a7120f1a0c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:32.113151 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b163218e-b534-4068-a3c6-19a7120f1a0c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:32.114603 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b163218e-b534-4068-a3c6-19a7120f1a0c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:32.115106 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b163218e-b534-4068-a3c6-19a7120f1a0c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:32.134684 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b459a1dd-9495-4e27-8844-778581eea0a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:32.142146 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b459a1dd-9495-4e27-8844-778581eea0a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.149979 May 23 10:53:32.142722 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 112/226] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:31 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:32.251421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b163218e-b534-4068-a3c6-19a7120f1a0c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:32.260102 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b163218e-b534-4068-a3c6-19a7120f1a0c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.159371 May 23 10:53:32.260648 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 115/227] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:32 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:32.514847 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-748145c8-9da5-4c9c-b7a2-93267fae8abc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:32.515658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-748145c8-9da5-4c9c-b7a2-93267fae8abc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:32.522749 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-748145c8-9da5-4c9c-b7a2-93267fae8abc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:32.523203 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-748145c8-9da5-4c9c-b7a2-93267fae8abc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:32.523968 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-748145c8-9da5-4c9c-b7a2-93267fae8abc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:32.524404 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-748145c8-9da5-4c9c-b7a2-93267fae8abc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:32.685709 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-748145c8-9da5-4c9c-b7a2-93267fae8abc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:32.696031 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-748145c8-9da5-4c9c-b7a2-93267fae8abc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:32.697773 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-748145c8-9da5-4c9c-b7a2-93267fae8abc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:32.701740 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-748145c8-9da5-4c9c-b7a2-93267fae8abc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1738 microversion: 2.20 time: 0.188048 May 23 10:53:32.705896 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 113/228] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:32 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:33.159237 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-93981ec2-057c-447c-8631-dc580336f83e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:33.161106 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-93981ec2-057c-447c-8631-dc580336f83e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:33.168388 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-93981ec2-057c-447c-8631-dc580336f83e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:33.169048 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-93981ec2-057c-447c-8631-dc580336f83e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:33.170026 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-93981ec2-057c-447c-8631-dc580336f83e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:33.170723 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-93981ec2-057c-447c-8631-dc580336f83e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:33.286493 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-678ed51a-e7b5-4ccf-aadf-28c561f0c262 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:33.287219 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-678ed51a-e7b5-4ccf-aadf-28c561f0c262 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:33.294198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-678ed51a-e7b5-4ccf-aadf-28c561f0c262 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:33.294728 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-678ed51a-e7b5-4ccf-aadf-28c561f0c262 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:33.295702 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-678ed51a-e7b5-4ccf-aadf-28c561f0c262 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:33.296218 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-678ed51a-e7b5-4ccf-aadf-28c561f0c262 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:33.356378 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-93981ec2-057c-447c-8631-dc580336f83e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:33.369489 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-93981ec2-057c-447c-8631-dc580336f83e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.214149 May 23 10:53:33.371002 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 116/229] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:33 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:33.466712 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-678ed51a-e7b5-4ccf-aadf-28c561f0c262 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:33.479291 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-678ed51a-e7b5-4ccf-aadf-28c561f0c262 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.205900 May 23 10:53:33.490241 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 114/230] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:33 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:33.637924 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-783ee82f-54d3-44e0-9c6e-1048a521fc72 req-0e3732f5-5ff3-4bb2-9e32-c37f1d260119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61941d-0058-4809-83b9-676d70df112a", "name": "network-vif-plugged", "status": "completed", "tag": "5b53bf83-661d-4063-8ac0-99bf4069b7ab"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:33.651449 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-783ee82f-54d3-44e0-9c6e-1048a521fc72 req-0e3732f5-5ff3-4bb2-9e32-c37f1d260119 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:33.652160 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-783ee82f-54d3-44e0-9c6e-1048a521fc72 req-0e3732f5-5ff3-4bb2-9e32-c37f1d260119 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:33.667007 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-783ee82f-54d3-44e0-9c6e-1048a521fc72 req-0e3732f5-5ff3-4bb2-9e32-c37f1d260119 service nova] Creating event network-vif-plugged:5b53bf83-661d-4063-8ac0-99bf4069b7ab for instance 1e61941d-0058-4809-83b9-676d70df112a on hv-cinder-83699 May 23 10:53:33.675908 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-783ee82f-54d3-44e0-9c6e-1048a521fc72 req-0e3732f5-5ff3-4bb2-9e32-c37f1d260119 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041474 May 23 10:53:33.677552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 117/231] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:33.717652 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c4568f6e-3e78-4992-8316-fa33c2368492 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:33.718292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c4568f6e-3e78-4992-8316-fa33c2368492 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:33.727589 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4568f6e-3e78-4992-8316-fa33c2368492 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:33.728039 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4568f6e-3e78-4992-8316-fa33c2368492 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:33.728808 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4568f6e-3e78-4992-8316-fa33c2368492 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:33.729243 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4568f6e-3e78-4992-8316-fa33c2368492 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:33.894820 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c4568f6e-3e78-4992-8316-fa33c2368492 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:33.904093 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c4568f6e-3e78-4992-8316-fa33c2368492 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:33.905590 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c4568f6e-3e78-4992-8316-fa33c2368492 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:33.906789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c4568f6e-3e78-4992-8316-fa33c2368492 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1738 microversion: 2.20 time: 0.193822 May 23 10:53:33.907347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 115/232] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:33 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:34.387901 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3a524fc9-193c-4879-a4ab-baf5da688e16 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:34.388600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3a524fc9-193c-4879-a4ab-baf5da688e16 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:34.397753 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3a524fc9-193c-4879-a4ab-baf5da688e16 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:34.398495 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3a524fc9-193c-4879-a4ab-baf5da688e16 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:34.399460 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3a524fc9-193c-4879-a4ab-baf5da688e16 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:34.400324 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3a524fc9-193c-4879-a4ab-baf5da688e16 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:34.497195 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7225955a-6250-4390-a914-685bacab83e7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:34.498456 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-7225955a-6250-4390-a914-685bacab83e7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:34.505065 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7225955a-6250-4390-a914-685bacab83e7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:34.505517 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7225955a-6250-4390-a914-685bacab83e7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:34.506325 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7225955a-6250-4390-a914-685bacab83e7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:34.506763 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7225955a-6250-4390-a914-685bacab83e7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:34.603129 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3a524fc9-193c-4879-a4ab-baf5da688e16 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:34.613146 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3a524fc9-193c-4879-a4ab-baf5da688e16 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.229896 May 23 10:53:34.614463 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 118/233] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:34 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:34.749693 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-7225955a-6250-4390-a914-685bacab83e7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:34.758468 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-7225955a-6250-4390-a914-685bacab83e7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.265048 May 23 10:53:34.773168 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 116/234] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:34 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:34.927378 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-62ddecd6-57d8-456e-bcb3-3aa579111f98 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:34.928398 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-62ddecd6-57d8-456e-bcb3-3aa579111f98 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:34.934752 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-62ddecd6-57d8-456e-bcb3-3aa579111f98 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:34.935470 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-62ddecd6-57d8-456e-bcb3-3aa579111f98 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:34.936436 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-62ddecd6-57d8-456e-bcb3-3aa579111f98 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:34.936872 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-62ddecd6-57d8-456e-bcb3-3aa579111f98 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:35.095436 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-62ddecd6-57d8-456e-bcb3-3aa579111f98 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:35.104277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-62ddecd6-57d8-456e-bcb3-3aa579111f98 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:35.106248 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-62ddecd6-57d8-456e-bcb3-3aa579111f98 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:35.107905 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-62ddecd6-57d8-456e-bcb3-3aa579111f98 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1738 microversion: 2.20 time: 0.184479 May 23 10:53:35.119390 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 119/235] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:34 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:35.636287 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6ec3fc9d-e024-4157-9b6c-0e66e9e69458 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:35.636287 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6ec3fc9d-e024-4157-9b6c-0e66e9e69458 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:35.642303 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ec3fc9d-e024-4157-9b6c-0e66e9e69458 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:35.643027 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ec3fc9d-e024-4157-9b6c-0e66e9e69458 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:35.643985 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ec3fc9d-e024-4157-9b6c-0e66e9e69458 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:35.644582 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ec3fc9d-e024-4157-9b6c-0e66e9e69458 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:35.650074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=100 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:35.775390 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-304b344c-294f-4c6c-8d77-513b597a80dc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:35.776652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-304b344c-294f-4c6c-8d77-513b597a80dc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:35.784345 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-304b344c-294f-4c6c-8d77-513b597a80dc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:35.785044 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-304b344c-294f-4c6c-8d77-513b597a80dc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:35.786566 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-304b344c-294f-4c6c-8d77-513b597a80dc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:35.787146 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-304b344c-294f-4c6c-8d77-513b597a80dc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:35.793094 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:35.845595 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6ec3fc9d-e024-4157-9b6c-0e66e9e69458 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:35.866014 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6ec3fc9d-e024-4157-9b6c-0e66e9e69458 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.236210 May 23 10:53:35.877558 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 117/236] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:35 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:36.032856 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-304b344c-294f-4c6c-8d77-513b597a80dc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:36.042542 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-304b344c-294f-4c6c-8d77-513b597a80dc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.270539 May 23 10:53:36.043183 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 120/237] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:35 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:36.127612 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b8d667a4-7a0f-43be-9e77-ae2f99d254a8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:36.128493 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b8d667a4-7a0f-43be-9e77-ae2f99d254a8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:36.136048 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b8d667a4-7a0f-43be-9e77-ae2f99d254a8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:36.136779 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b8d667a4-7a0f-43be-9e77-ae2f99d254a8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:36.137637 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b8d667a4-7a0f-43be-9e77-ae2f99d254a8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:36.138304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b8d667a4-7a0f-43be-9e77-ae2f99d254a8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:36.354994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b8d667a4-7a0f-43be-9e77-ae2f99d254a8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:36.370660 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b8d667a4-7a0f-43be-9e77-ae2f99d254a8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:36.372826 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b8d667a4-7a0f-43be-9e77-ae2f99d254a8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:36.374604 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b8d667a4-7a0f-43be-9e77-ae2f99d254a8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1738 microversion: 2.20 time: 0.251622 May 23 10:53:36.375689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 118/238] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:36 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:53:36.895801 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5908cb1b-275c-4400-ad4a-97af1cdb8d54 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:36.899072 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5908cb1b-275c-4400-ad4a-97af1cdb8d54 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:36.908344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5908cb1b-275c-4400-ad4a-97af1cdb8d54 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:36.909527 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5908cb1b-275c-4400-ad4a-97af1cdb8d54 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:36.911410 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5908cb1b-275c-4400-ad4a-97af1cdb8d54 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:36.914896 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5908cb1b-275c-4400-ad4a-97af1cdb8d54 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:37.064413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7d9c0255-39a0-4f8a-9700-f44a93dcb428 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:37.065029 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-7d9c0255-39a0-4f8a-9700-f44a93dcb428 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:37.077640 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d9c0255-39a0-4f8a-9700-f44a93dcb428 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:37.078782 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d9c0255-39a0-4f8a-9700-f44a93dcb428 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:37.083768 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d9c0255-39a0-4f8a-9700-f44a93dcb428 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:37.084222 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d9c0255-39a0-4f8a-9700-f44a93dcb428 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:37.139466 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5908cb1b-275c-4400-ad4a-97af1cdb8d54 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:37.160293 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5908cb1b-275c-4400-ad4a-97af1cdb8d54 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.268764 May 23 10:53:37.161680 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 121/239] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:36 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:37.308821 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-7d9c0255-39a0-4f8a-9700-f44a93dcb428 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:37.318690 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-7d9c0255-39a0-4f8a-9700-f44a93dcb428 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.258835 May 23 10:53:37.320001 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 119/240] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:37 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:37.398099 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1e7842b3-06b9-44f9-b617-661749649f3f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:37.398907 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1e7842b3-06b9-44f9-b617-661749649f3f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:37.405221 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1e7842b3-06b9-44f9-b617-661749649f3f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:37.405889 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1e7842b3-06b9-44f9-b617-661749649f3f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:37.406696 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1e7842b3-06b9-44f9-b617-661749649f3f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:37.407510 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1e7842b3-06b9-44f9-b617-661749649f3f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:37.625231 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1e7842b3-06b9-44f9-b617-661749649f3f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:37.637402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1e7842b3-06b9-44f9-b617-661749649f3f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:37.641415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1e7842b3-06b9-44f9-b617-661749649f3f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:37.645621 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1e7842b3-06b9-44f9-b617-661749649f3f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1738 microversion: 2.20 time: 0.252139 May 23 10:53:37.646569 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 122/241] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:37 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:38.178671 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-cdef7e57-fa80-482f-93db-bd47237bdc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:38.179907 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-cdef7e57-fa80-482f-93db-bd47237bdc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:38.189601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cdef7e57-fa80-482f-93db-bd47237bdc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:38.190081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cdef7e57-fa80-482f-93db-bd47237bdc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:38.190874 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cdef7e57-fa80-482f-93db-bd47237bdc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:38.191313 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cdef7e57-fa80-482f-93db-bd47237bdc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:38.338232 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0310b867-8c54-4f60-a2da-c9ccc2727c52 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:38.339634 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-0310b867-8c54-4f60-a2da-c9ccc2727c52 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:38.352500 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0310b867-8c54-4f60-a2da-c9ccc2727c52 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:38.353227 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0310b867-8c54-4f60-a2da-c9ccc2727c52 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:38.354321 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0310b867-8c54-4f60-a2da-c9ccc2727c52 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:38.354915 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0310b867-8c54-4f60-a2da-c9ccc2727c52 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:38.369602 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-cdef7e57-fa80-482f-93db-bd47237bdc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:38.379589 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-cdef7e57-fa80-482f-93db-bd47237bdc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.205247 May 23 10:53:38.381250 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 120/242] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:38 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:38.496745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-0310b867-8c54-4f60-a2da-c9ccc2727c52 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:38.508491 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-0310b867-8c54-4f60-a2da-c9ccc2727c52 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.174200 May 23 10:53:38.509086 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 123/243] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:38 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:38.663894 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8603dc17-2f6d-4103-8a9f-30fa2afbdebb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:38.664503 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8603dc17-2f6d-4103-8a9f-30fa2afbdebb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:38.671127 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8603dc17-2f6d-4103-8a9f-30fa2afbdebb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:38.671573 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8603dc17-2f6d-4103-8a9f-30fa2afbdebb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:38.672347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8603dc17-2f6d-4103-8a9f-30fa2afbdebb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:38.672774 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8603dc17-2f6d-4103-8a9f-30fa2afbdebb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:38.830988 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8603dc17-2f6d-4103-8a9f-30fa2afbdebb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:38.843750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8603dc17-2f6d-4103-8a9f-30fa2afbdebb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:38.845254 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8603dc17-2f6d-4103-8a9f-30fa2afbdebb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:38.846452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8603dc17-2f6d-4103-8a9f-30fa2afbdebb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1738 microversion: 2.20 time: 0.187153 May 23 10:53:38.847208 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 121/244] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:38 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:39.160213 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1238304861", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452"}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:39.244853 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] validate_networks() for None {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:53:39.398228 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3447e580-ecb3-4b0f-a907-df34c26b88e8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:39.399573 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3447e580-ecb3-4b0f-a907-df34c26b88e8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:39.418001 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3447e580-ecb3-4b0f-a907-df34c26b88e8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:39.418708 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3447e580-ecb3-4b0f-a907-df34c26b88e8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:39.419725 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3447e580-ecb3-4b0f-a907-df34c26b88e8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:39.420332 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3447e580-ecb3-4b0f-a907-df34c26b88e8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:39.596259 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3447e580-ecb3-4b0f-a907-df34c26b88e8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:39.604195 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3447e580-ecb3-4b0f-a907-df34c26b88e8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.211479 May 23 10:53:39.618102 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 122/245] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:39 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:39.623091 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-fe1321bd-93f6-4dea-ac28-84931dd5a066 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: .version_select at 0x7fe720319700>, body: {"keypair": {"name": "tempest-keypair-301637765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM4GLzrYdfId24fxuCQfaI4KU9Wz8vrL8qLZ41oBYAJLWKBW8aJxXctg22cYOXXm5Ne2gtg/xjQ/OhB+JHCA/wBBdbF8XE4fsO1AiZxu1eXKrSvLfTR5xMk+zJ8EA4J5Q=="}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:39.641417 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-fe1321bd-93f6-4dea-ac28-84931dd5a066 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:53:39.646087 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-fe1321bd-93f6-4dea-ac28-84931dd5a066 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for user 8e98c8ceac6b47079423b45685c5ba3e and project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:53:39.678476 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-fe1321bd-93f6-4dea-ac28-84931dd5a066 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059050 May 23 10:53:39.679823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 123/246] 10.222.0.36 () {60 vars in 1158 bytes} [Mon May 23 10:53:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:39.691174 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-34d7edfc-6adb-45fe-b9f2-d3d8bc39d94b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:39.692797 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-34d7edfc-6adb-45fe-b9f2-d3d8bc39d94b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:39.700378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34d7edfc-6adb-45fe-b9f2-d3d8bc39d94b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:39.701186 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34d7edfc-6adb-45fe-b9f2-d3d8bc39d94b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:39.702380 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34d7edfc-6adb-45fe-b9f2-d3d8bc39d94b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:39.703074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-34d7edfc-6adb-45fe-b9f2-d3d8bc39d94b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:39.822766 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:53:39.823849 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:53:39.824960 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:53:39.825533 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:53:39.826653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:53:39.846479 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:39.847291 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:39.848922 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:39.849585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:39.871232 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Getting quotas for project b67f4759ef6a47b888079e98fee54fa3. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:53:39.876011 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Getting quotas for user e35d08a3e6fe47d7a29a991a44498eaa and project b67f4759ef6a47b888079e98fee54fa3. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:53:39.893035 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:53:39.897061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:53:39.977308 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3f4fe326-ec20-443b-a008-ebf6e582a75e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825854 May 23 10:53:39.982924 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 124/247] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:53:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:53:39.983249 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1359b32b-3604-4090-950a-4028499cac1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:39.984024 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1359b32b-3604-4090-950a-4028499cac1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:39.992749 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1359b32b-3604-4090-950a-4028499cac1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:39.993965 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1359b32b-3604-4090-950a-4028499cac1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:39.994974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1359b32b-3604-4090-950a-4028499cac1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:39.995610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1359b32b-3604-4090-950a-4028499cac1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:40.021397 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-34d7edfc-6adb-45fe-b9f2-d3d8bc39d94b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:40.032099 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-34d7edfc-6adb-45fe-b9f2-d3d8bc39d94b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.345368 May 23 10:53:40.036400 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 124/248] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:39 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:40.051758 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-51147e95-f793-4e22-a824-e533d675deb7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:40.061089 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-51147e95-f793-4e22-a824-e533d675deb7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:40.153399 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-51147e95-f793-4e22-a824-e533d675deb7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:40.160223 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-51147e95-f793-4e22-a824-e533d675deb7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1215 microversion: 2.1 time: 0.113072 May 23 10:53:40.162310 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 125/249] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:40 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:40.370821 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1359b32b-3604-4090-950a-4028499cac1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:40.394239 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1359b32b-3604-4090-950a-4028499cac1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:40.404615 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1359b32b-3604-4090-950a-4028499cac1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:40.414418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1359b32b-3604-4090-950a-4028499cac1c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1738 microversion: 2.20 time: 0.426049 May 23 10:53:40.416150 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 125/250] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:39 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1738 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:40.629823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2637af45-910a-4179-a123-4b9c36ef96a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:40.631095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2637af45-910a-4179-a123-4b9c36ef96a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:40.638098 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2637af45-910a-4179-a123-4b9c36ef96a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:40.638767 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2637af45-910a-4179-a123-4b9c36ef96a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:40.642761 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2637af45-910a-4179-a123-4b9c36ef96a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:40.643869 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2637af45-910a-4179-a123-4b9c36ef96a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:40.859187 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2637af45-910a-4179-a123-4b9c36ef96a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:40.869361 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2637af45-910a-4179-a123-4b9c36ef96a8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.248360 May 23 10:53:40.869991 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 126/251] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:40 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:41.058022 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fbbe8204-8cc4-4c21-9a05-2814f4128dcc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:41.060001 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-fbbe8204-8cc4-4c21-9a05-2814f4128dcc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:41.070796 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fbbe8204-8cc4-4c21-9a05-2814f4128dcc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:41.072234 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fbbe8204-8cc4-4c21-9a05-2814f4128dcc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:41.073264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fbbe8204-8cc4-4c21-9a05-2814f4128dcc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:41.073920 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fbbe8204-8cc4-4c21-9a05-2814f4128dcc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:41.184511 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e906ee0e-8f62-4b9a-acbd-b08a5e2a8cee tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:41.187516 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e906ee0e-8f62-4b9a-acbd-b08a5e2a8cee tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:41.197904 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e906ee0e-8f62-4b9a-acbd-b08a5e2a8cee tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:41.199230 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e906ee0e-8f62-4b9a-acbd-b08a5e2a8cee tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:41.200260 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e906ee0e-8f62-4b9a-acbd-b08a5e2a8cee tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:41.201189 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e906ee0e-8f62-4b9a-acbd-b08a5e2a8cee tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:41.249607 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fbbe8204-8cc4-4c21-9a05-2814f4128dcc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:41.262146 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fbbe8204-8cc4-4c21-9a05-2814f4128dcc tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.209937 May 23 10:53:41.273113 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 126/252] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:41 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:41.320436 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e906ee0e-8f62-4b9a-acbd-b08a5e2a8cee tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:41.334658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e906ee0e-8f62-4b9a-acbd-b08a5e2a8cee tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1211 microversion: 2.1 time: 0.160625 May 23 10:53:41.355585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 127/253] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:41 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1211 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:41.439809 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e3d1bb56-3049-47ed-8f28-2b7a4d8059ea tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:41.441017 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e3d1bb56-3049-47ed-8f28-2b7a4d8059ea tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:41.449143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e3d1bb56-3049-47ed-8f28-2b7a4d8059ea tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:41.449911 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e3d1bb56-3049-47ed-8f28-2b7a4d8059ea tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:41.450960 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e3d1bb56-3049-47ed-8f28-2b7a4d8059ea tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:41.451471 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e3d1bb56-3049-47ed-8f28-2b7a4d8059ea tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:41.629803 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e3d1bb56-3049-47ed-8f28-2b7a4d8059ea tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:41.649380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e3d1bb56-3049-47ed-8f28-2b7a4d8059ea tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:41.657490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e3d1bb56-3049-47ed-8f28-2b7a4d8059ea tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:41.659003 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e3d1bb56-3049-47ed-8f28-2b7a4d8059ea tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1738 microversion: 2.20 time: 0.227057 May 23 10:53:41.675703 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 127/254] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:41 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:41.810809 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-153331216", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6500cd5-4edf-47aa-9e35-9691dad60917"}], "security_groups": [{"name": "tempest-securitygroup--2083482899"}], "key_name": "tempest-keypair-301637765", "user_data": "}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:41.886835 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-10c87a6d-9e9c-4548-8841-02c092b4f07d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:41.887852 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-10c87a6d-9e9c-4548-8841-02c092b4f07d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:41.899619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-10c87a6d-9e9c-4548-8841-02c092b4f07d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:41.900714 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-10c87a6d-9e9c-4548-8841-02c092b4f07d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:41.903241 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-10c87a6d-9e9c-4548-8841-02c092b4f07d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:41.905665 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-10c87a6d-9e9c-4548-8841-02c092b4f07d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:41.958253 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.network.neutron [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] validate_networks() for [('f6500cd5-4edf-47aa-9e35-9691dad60917', None, None, None, None, None)] {{(pid=129030) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:53:42.182581 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-10c87a6d-9e9c-4548-8841-02c092b4f07d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:42.202866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-10c87a6d-9e9c-4548-8841-02c092b4f07d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.320129 May 23 10:53:42.203471 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 128/255] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:41 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:42.282895 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d9a52b7f-b6bf-4cd7-a310-ca8342168eb0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:42.283652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d9a52b7f-b6bf-4cd7-a310-ca8342168eb0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:42.295572 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d9a52b7f-b6bf-4cd7-a310-ca8342168eb0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:42.296254 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d9a52b7f-b6bf-4cd7-a310-ca8342168eb0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:42.297543 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d9a52b7f-b6bf-4cd7-a310-ca8342168eb0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:42.298162 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d9a52b7f-b6bf-4cd7-a310-ca8342168eb0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:42.492153 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Flavor limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:53:42.493084 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Image limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:53:42.493827 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Flavor pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:53:42.494497 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Image pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:53:42.495251 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:53:42.505403 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:42.506017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:42.506902 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:42.507435 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:42.521063 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d9a52b7f-b6bf-4cd7-a310-ca8342168eb0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:42.526445 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:53:42.529908 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d9a52b7f-b6bf-4cd7-a310-ca8342168eb0 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.252494 May 23 10:53:42.530559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 129/256] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:42 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:42.532366 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for user 8e98c8ceac6b47079423b45685c5ba3e and project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:53:42.536136 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-462abf4c-dc59-4e40-b291-bdec6c636581 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:42.537521 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-462abf4c-dc59-4e40-b291-bdec6c636581 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:42.544166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-462abf4c-dc59-4e40-b291-bdec6c636581 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:42.544813 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-462abf4c-dc59-4e40-b291-bdec6c636581 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:42.545848 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Going to run 1 instances... {{(pid=129030) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:53:42.546021 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-462abf4c-dc59-4e40-b291-bdec6c636581 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:42.546352 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-462abf4c-dc59-4e40-b291-bdec6c636581 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:42.548178 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:53:42.608499 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-88163b41-5bc7-41b7-bcb9-b4033f1d93c7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.801994 May 23 10:53:42.609159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 128/257] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:53:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:53:42.624033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-462abf4c-dc59-4e40-b291-bdec6c636581 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:42.631839 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ca44cb46-fde7-4fdb-bb4c-57d098a1b733 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:42.637317 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ca44cb46-fde7-4fdb-bb4c-57d098a1b733 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:42.640758 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-462abf4c-dc59-4e40-b291-bdec6c636581 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1273 microversion: 2.1 time: 0.108500 May 23 10:53:42.642567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 130/258] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:42 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:42.697257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bd236e47-d830-4bbe-b808-306fac8c3be7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:42.698373 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bd236e47-d830-4bbe-b808-306fac8c3be7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:42.711840 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bd236e47-d830-4bbe-b808-306fac8c3be7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:42.712571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bd236e47-d830-4bbe-b808-306fac8c3be7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:42.713835 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bd236e47-d830-4bbe-b808-306fac8c3be7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:42.714482 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bd236e47-d830-4bbe-b808-306fac8c3be7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:42.718058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ca44cb46-fde7-4fdb-bb4c-57d098a1b733 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:42.730652 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ca44cb46-fde7-4fdb-bb4c-57d098a1b733 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1240 microversion: 2.1 time: 0.108603 May 23 10:53:42.732089 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 129/259] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:42 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:43.028410 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bd236e47-d830-4bbe-b808-306fac8c3be7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:43.041468 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bd236e47-d830-4bbe-b808-306fac8c3be7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:43.043887 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bd236e47-d830-4bbe-b808-306fac8c3be7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:43.046404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bd236e47-d830-4bbe-b808-306fac8c3be7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1738 microversion: 2.20 time: 0.368243 May 23 10:53:43.061771 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 131/260] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:42 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1738 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:43.220497 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5adbba7a-f2a4-49c4-8fcc-709e933889f2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:43.221089 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5adbba7a-f2a4-49c4-8fcc-709e933889f2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:43.230810 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5adbba7a-f2a4-49c4-8fcc-709e933889f2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:43.232101 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5adbba7a-f2a4-49c4-8fcc-709e933889f2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:43.233064 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5adbba7a-f2a4-49c4-8fcc-709e933889f2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:43.233651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5adbba7a-f2a4-49c4-8fcc-709e933889f2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:43.429309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5adbba7a-f2a4-49c4-8fcc-709e933889f2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:43.443042 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5adbba7a-f2a4-49c4-8fcc-709e933889f2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.226292 May 23 10:53:43.451589 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 130/261] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:43 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:43.547088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-604736ec-c68d-41cb-b4e9-d7048b893f7b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:43.548026 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-604736ec-c68d-41cb-b4e9-d7048b893f7b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:43.558160 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:43.561631 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-604736ec-c68d-41cb-b4e9-d7048b893f7b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:43.562896 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-604736ec-c68d-41cb-b4e9-d7048b893f7b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:43.564004 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-604736ec-c68d-41cb-b4e9-d7048b893f7b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:43.564652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-604736ec-c68d-41cb-b4e9-d7048b893f7b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:43.659003 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ad4c044d-b486-4929-bc06-45eff780741d tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:43.665182 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ad4c044d-b486-4929-bc06-45eff780741d tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:43.682792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ad4c044d-b486-4929-bc06-45eff780741d tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:43.683376 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ad4c044d-b486-4929-bc06-45eff780741d tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:43.684413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ad4c044d-b486-4929-bc06-45eff780741d tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:43.694634 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ad4c044d-b486-4929-bc06-45eff780741d tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:43.824628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-604736ec-c68d-41cb-b4e9-d7048b893f7b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:43.837524 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-604736ec-c68d-41cb-b4e9-d7048b893f7b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1723 microversion: 2.1 time: 0.294577 May 23 10:53:43.840568 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 132/262] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:43 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:43.862617 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a8331acb-0188-4d4d-a2eb-56e87f46c585 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:43.864282 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a8331acb-0188-4d4d-a2eb-56e87f46c585 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:43.864409 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ad4c044d-b486-4929-bc06-45eff780741d tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:43.873426 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8331acb-0188-4d4d-a2eb-56e87f46c585 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:43.873795 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ad4c044d-b486-4929-bc06-45eff780741d tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1315 microversion: 2.1 time: 0.218809 May 23 10:53:43.874526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8331acb-0188-4d4d-a2eb-56e87f46c585 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:43.875655 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8331acb-0188-4d4d-a2eb-56e87f46c585 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:43.876432 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8331acb-0188-4d4d-a2eb-56e87f46c585 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:43.884344 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 131/263] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:43 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:43.978608 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a8331acb-0188-4d4d-a2eb-56e87f46c585 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:43.988035 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a8331acb-0188-4d4d-a2eb-56e87f46c585 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1292 microversion: 2.1 time: 0.145988 May 23 10:53:43.989312 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 133/264] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:43 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1292 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:44.070541 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-301abdef-0d55-4907-9c9a-f4d6b0de77f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:44.071256 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-301abdef-0d55-4907-9c9a-f4d6b0de77f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:44.079480 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-301abdef-0d55-4907-9c9a-f4d6b0de77f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:44.082055 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-301abdef-0d55-4907-9c9a-f4d6b0de77f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:44.083049 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-301abdef-0d55-4907-9c9a-f4d6b0de77f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:44.083646 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-301abdef-0d55-4907-9c9a-f4d6b0de77f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:44.365388 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-301abdef-0d55-4907-9c9a-f4d6b0de77f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:44.374663 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-301abdef-0d55-4907-9c9a-f4d6b0de77f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:44.376313 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-301abdef-0d55-4907-9c9a-f4d6b0de77f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:44.377606 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-301abdef-0d55-4907-9c9a-f4d6b0de77f0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1738 microversion: 2.20 time: 0.314690 May 23 10:53:44.378202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 132/265] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:44 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:44.460109 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9541929e-9893-4bb2-83b8-f6f6c1c36799 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:44.460716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9541929e-9893-4bb2-83b8-f6f6c1c36799 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:44.467092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9541929e-9893-4bb2-83b8-f6f6c1c36799 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:44.467543 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9541929e-9893-4bb2-83b8-f6f6c1c36799 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:44.468308 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9541929e-9893-4bb2-83b8-f6f6c1c36799 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:44.469041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9541929e-9893-4bb2-83b8-f6f6c1c36799 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:44.474106 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-6499b148-710b-4fc8-969a-69dce08fd3bf req-0ffe8e7a-6d54-4df3-935f-712f077fcb19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279d8cbc-fd45-48d5-b072-43ce43dd7fba", "tag": "ce7f026a-53bb-47d5-b04f-fed5afa345a9"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:44.485212 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-6499b148-710b-4fc8-969a-69dce08fd3bf req-0ffe8e7a-6d54-4df3-935f-712f077fcb19 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:44.485799 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-6499b148-710b-4fc8-969a-69dce08fd3bf req-0ffe8e7a-6d54-4df3-935f-712f077fcb19 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:44.499313 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-6499b148-710b-4fc8-969a-69dce08fd3bf req-0ffe8e7a-6d54-4df3-935f-712f077fcb19 service nova] Creating event network-changed:ce7f026a-53bb-47d5-b04f-fed5afa345a9 for instance 279d8cbc-fd45-48d5-b072-43ce43dd7fba on hv-cinder-83699 May 23 10:53:44.505333 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-6499b148-710b-4fc8-969a-69dce08fd3bf req-0ffe8e7a-6d54-4df3-935f-712f077fcb19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035210 May 23 10:53:44.506598 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 133/266] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:53:44.858807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-be74c36c-9561-4c20-9f04-1dead7df07ca tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:44.859615 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-be74c36c-9561-4c20-9f04-1dead7df07ca tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:44.870792 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9541929e-9893-4bb2-83b8-f6f6c1c36799 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:44.880582 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-be74c36c-9561-4c20-9f04-1dead7df07ca tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:44.881042 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-be74c36c-9561-4c20-9f04-1dead7df07ca tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:44.882489 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-be74c36c-9561-4c20-9f04-1dead7df07ca tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:44.882899 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9541929e-9893-4bb2-83b8-f6f6c1c36799 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.426489 May 23 10:53:44.883017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-be74c36c-9561-4c20-9f04-1dead7df07ca tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:44.883653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 134/267] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:44 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:44.898774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6df2691b-4623-48c3-bd51-3dadf6312566 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:44.899726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6df2691b-4623-48c3-bd51-3dadf6312566 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:44.908637 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6df2691b-4623-48c3-bd51-3dadf6312566 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:44.910049 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6df2691b-4623-48c3-bd51-3dadf6312566 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:44.912163 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6df2691b-4623-48c3-bd51-3dadf6312566 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:44.912883 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6df2691b-4623-48c3-bd51-3dadf6312566 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:45.164399 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-be74c36c-9561-4c20-9f04-1dead7df07ca tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:45.174570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-be74c36c-9561-4c20-9f04-1dead7df07ca tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1700 microversion: 2.1 time: 0.320379 May 23 10:53:45.175328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 134/268] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:44 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1700 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:45.180328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c59079fd-28e9-467c-8e62-b32c3d3ee372 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:45.181128 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c59079fd-28e9-467c-8e62-b32c3d3ee372 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:45.189863 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6df2691b-4623-48c3-bd51-3dadf6312566 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:45.196883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c59079fd-28e9-467c-8e62-b32c3d3ee372 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:45.197338 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c59079fd-28e9-467c-8e62-b32c3d3ee372 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:45.198164 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c59079fd-28e9-467c-8e62-b32c3d3ee372 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:45.198606 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c59079fd-28e9-467c-8e62-b32c3d3ee372 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:45.202882 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6df2691b-4623-48c3-bd51-3dadf6312566 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1315 microversion: 2.1 time: 0.314447 May 23 10:53:45.204157 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 135/269] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:44 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:45.209612 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c1795912-6cdf-40d2-afcc-7e1b799fa106 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:45.217500 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c1795912-6cdf-40d2-afcc-7e1b799fa106 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:45.218130 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c1795912-6cdf-40d2-afcc-7e1b799fa106 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:45.253403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c1795912-6cdf-40d2-afcc-7e1b799fa106 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Going to try to start instance {{(pid=129029) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 10:53:45.284441 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:45.318437 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c1795912-6cdf-40d2-afcc-7e1b799fa106 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/action" status: 202 len: 0 microversion: 2.1 time: 0.112775 May 23 10:53:45.319057 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 136/270] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 10:53:45 2022] POST /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:53:45.327925 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b5fde21e-2ee8-4155-aebd-513e9a07fdc1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:45.328775 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b5fde21e-2ee8-4155-aebd-513e9a07fdc1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:45.336217 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b5fde21e-2ee8-4155-aebd-513e9a07fdc1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:45.336661 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b5fde21e-2ee8-4155-aebd-513e9a07fdc1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:45.337436 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b5fde21e-2ee8-4155-aebd-513e9a07fdc1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:45.338503 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b5fde21e-2ee8-4155-aebd-513e9a07fdc1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:45.643898 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b5fde21e-2ee8-4155-aebd-513e9a07fdc1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:45.652792 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b5fde21e-2ee8-4155-aebd-513e9a07fdc1 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1709 microversion: 2.1 time: 0.329109 May 23 10:53:45.662995 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 137/271] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:45 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1709 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:45.668006 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a1e2cbb2-731b-4f8a-8cd0-3970050ff21c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:45.668617 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a1e2cbb2-731b-4f8a-8cd0-3970050ff21c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:45.674653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a1e2cbb2-731b-4f8a-8cd0-3970050ff21c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:45.675311 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a1e2cbb2-731b-4f8a-8cd0-3970050ff21c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:45.676650 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a1e2cbb2-731b-4f8a-8cd0-3970050ff21c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:45.677081 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a1e2cbb2-731b-4f8a-8cd0-3970050ff21c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:45.780639 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c59079fd-28e9-467c-8e62-b32c3d3ee372 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:45.789821 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c59079fd-28e9-467c-8e62-b32c3d3ee372 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.613101 May 23 10:53:45.790588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 135/272] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:45 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:45.899621 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2d4246f0-b56a-4bdd-bfd7-5ea4ba3ddd97 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:45.900395 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2d4246f0-b56a-4bdd-bfd7-5ea4ba3ddd97 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:45.906832 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2d4246f0-b56a-4bdd-bfd7-5ea4ba3ddd97 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:45.908015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2d4246f0-b56a-4bdd-bfd7-5ea4ba3ddd97 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:45.908869 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2d4246f0-b56a-4bdd-bfd7-5ea4ba3ddd97 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:45.910040 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2d4246f0-b56a-4bdd-bfd7-5ea4ba3ddd97 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:45.954284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a1e2cbb2-731b-4f8a-8cd0-3970050ff21c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:45.964159 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a1e2cbb2-731b-4f8a-8cd0-3970050ff21c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:45.965744 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a1e2cbb2-731b-4f8a-8cd0-3970050ff21c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:45.967022 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a1e2cbb2-731b-4f8a-8cd0-3970050ff21c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1720 microversion: 2.20 time: 0.302782 May 23 10:53:45.967700 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 138/273] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:45 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1720 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:46.139531 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2d4246f0-b56a-4bdd-bfd7-5ea4ba3ddd97 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:46.147221 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2d4246f0-b56a-4bdd-bfd7-5ea4ba3ddd97 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.251786 May 23 10:53:46.156400 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 136/274] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:45 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:46.220485 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-00d6cf5a-fc25-4375-97a5-fd9212da548e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:46.221108 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-00d6cf5a-fc25-4375-97a5-fd9212da548e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:46.227909 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-00d6cf5a-fc25-4375-97a5-fd9212da548e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:46.228398 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-00d6cf5a-fc25-4375-97a5-fd9212da548e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:46.229125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-00d6cf5a-fc25-4375-97a5-fd9212da548e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:46.229568 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-00d6cf5a-fc25-4375-97a5-fd9212da548e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:46.395943 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-00d6cf5a-fc25-4375-97a5-fd9212da548e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:46.403809 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-00d6cf5a-fc25-4375-97a5-fd9212da548e tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1315 microversion: 2.1 time: 0.187046 May 23 10:53:46.404690 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 139/275] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:46 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:46.479548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-f5d2ea5c-16d1-43f9-90be-cf9faef9cfae req-d6c6a7d1-5052-4bbf-8769-33fc505409b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1671c4-e70e-4431-88d7-9ea12615aa07", "tag": "09d7f930-a93b-4df0-9ea7-29ea518e1743"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:46.490407 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-f5d2ea5c-16d1-43f9-90be-cf9faef9cfae req-d6c6a7d1-5052-4bbf-8769-33fc505409b9 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:46.490990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-f5d2ea5c-16d1-43f9-90be-cf9faef9cfae req-d6c6a7d1-5052-4bbf-8769-33fc505409b9 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:46.504742 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-f5d2ea5c-16d1-43f9-90be-cf9faef9cfae req-d6c6a7d1-5052-4bbf-8769-33fc505409b9 service nova] Creating event network-changed:09d7f930-a93b-4df0-9ea7-29ea518e1743 for instance fc1671c4-e70e-4431-88d7-9ea12615aa07 on hv-cinder-83699 May 23 10:53:46.509417 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-f5d2ea5c-16d1-43f9-90be-cf9faef9cfae req-d6c6a7d1-5052-4bbf-8769-33fc505409b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033782 May 23 10:53:46.510056 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 137/276] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:53:46.670399 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-394575b6-eff2-44dd-b3b5-efead96517eb tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:46.671029 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-394575b6-eff2-44dd-b3b5-efead96517eb tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:46.677516 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-394575b6-eff2-44dd-b3b5-efead96517eb tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:46.677979 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-394575b6-eff2-44dd-b3b5-efead96517eb tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:46.678747 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-394575b6-eff2-44dd-b3b5-efead96517eb tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:46.679176 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-394575b6-eff2-44dd-b3b5-efead96517eb tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:46.804143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-394575b6-eff2-44dd-b3b5-efead96517eb tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:46.807695 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bb5495e7-3449-479a-a1bc-eb24677dfdad tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:46.808190 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-bb5495e7-3449-479a-a1bc-eb24677dfdad tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:46.812308 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-394575b6-eff2-44dd-b3b5-efead96517eb tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1709 microversion: 2.1 time: 0.145759 May 23 10:53:46.812888 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 140/277] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:46 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1709 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:46.814272 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bb5495e7-3449-479a-a1bc-eb24677dfdad tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:46.814719 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bb5495e7-3449-479a-a1bc-eb24677dfdad tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:46.815477 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bb5495e7-3449-479a-a1bc-eb24677dfdad tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:46.815907 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bb5495e7-3449-479a-a1bc-eb24677dfdad tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:46.942518 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-bb5495e7-3449-479a-a1bc-eb24677dfdad tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:46.945994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=100 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:46.950956 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-bb5495e7-3449-479a-a1bc-eb24677dfdad tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.147778 May 23 10:53:46.951519 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 138/278] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:46 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:46.985565 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5a8106b1-f8bb-4e6b-840d-975c592cc7b8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:46.986207 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5a8106b1-f8bb-4e6b-840d-975c592cc7b8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:46.992734 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5a8106b1-f8bb-4e6b-840d-975c592cc7b8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:46.993195 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5a8106b1-f8bb-4e6b-840d-975c592cc7b8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:46.993972 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5a8106b1-f8bb-4e6b-840d-975c592cc7b8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:46.994415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5a8106b1-f8bb-4e6b-840d-975c592cc7b8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:47.120805 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5a8106b1-f8bb-4e6b-840d-975c592cc7b8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:47.129534 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5a8106b1-f8bb-4e6b-840d-975c592cc7b8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:47.131076 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5a8106b1-f8bb-4e6b-840d-975c592cc7b8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:47.132230 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5a8106b1-f8bb-4e6b-840d-975c592cc7b8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1720 microversion: 2.20 time: 0.150560 May 23 10:53:47.132796 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 141/279] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:46 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:47.163465 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-46a02225-5c0f-4610-89e2-e375f98ba20e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:47.164077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-46a02225-5c0f-4610-89e2-e375f98ba20e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:47.170663 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-46a02225-5c0f-4610-89e2-e375f98ba20e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:47.171111 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-46a02225-5c0f-4610-89e2-e375f98ba20e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:47.171866 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-46a02225-5c0f-4610-89e2-e375f98ba20e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:47.172302 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-46a02225-5c0f-4610-89e2-e375f98ba20e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:47.415131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-46a02225-5c0f-4610-89e2-e375f98ba20e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:47.420509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d995c1ca-37d5-476b-a8ea-ae73952c2dd2 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:47.421385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d995c1ca-37d5-476b-a8ea-ae73952c2dd2 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:47.428274 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d995c1ca-37d5-476b-a8ea-ae73952c2dd2 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:47.428839 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d995c1ca-37d5-476b-a8ea-ae73952c2dd2 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:47.429728 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d995c1ca-37d5-476b-a8ea-ae73952c2dd2 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:47.430278 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d995c1ca-37d5-476b-a8ea-ae73952c2dd2 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:47.433847 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-46a02225-5c0f-4610-89e2-e375f98ba20e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.274179 May 23 10:53:47.434468 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 139/280] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:47 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:47.569413 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d995c1ca-37d5-476b-a8ea-ae73952c2dd2 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:47.576853 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d995c1ca-37d5-476b-a8ea-ae73952c2dd2 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1315 microversion: 2.1 time: 0.160181 May 23 10:53:47.577422 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 142/281] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:47 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:47.757811 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-04e04555-97f4-4666-b08f-9d0c1db81c2a req-21e515fc-b474-4f45-9c6e-6a0fbe27b723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61941d-0058-4809-83b9-676d70df112a", "name": "network-vif-unplugged", "status": "completed", "tag": "5b53bf83-661d-4063-8ac0-99bf4069b7ab"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:47.766313 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-04e04555-97f4-4666-b08f-9d0c1db81c2a req-21e515fc-b474-4f45-9c6e-6a0fbe27b723 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:47.766769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-04e04555-97f4-4666-b08f-9d0c1db81c2a req-21e515fc-b474-4f45-9c6e-6a0fbe27b723 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:47.780140 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-04e04555-97f4-4666-b08f-9d0c1db81c2a req-21e515fc-b474-4f45-9c6e-6a0fbe27b723 service nova] Creating event network-vif-unplugged:5b53bf83-661d-4063-8ac0-99bf4069b7ab for instance 1e61941d-0058-4809-83b9-676d70df112a on hv-cinder-83699 May 23 10:53:47.787228 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-04e04555-97f4-4666-b08f-9d0c1db81c2a req-21e515fc-b474-4f45-9c6e-6a0fbe27b723 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033144 May 23 10:53:47.787870 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 140/282] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:47.830230 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4cfc64fe-0b3d-4d17-9b55-c99b00867a18 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:47.830833 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-4cfc64fe-0b3d-4d17-9b55-c99b00867a18 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:47.838164 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4cfc64fe-0b3d-4d17-9b55-c99b00867a18 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:47.838614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4cfc64fe-0b3d-4d17-9b55-c99b00867a18 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:47.839459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4cfc64fe-0b3d-4d17-9b55-c99b00867a18 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:47.840055 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4cfc64fe-0b3d-4d17-9b55-c99b00867a18 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:47.967873 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-4cfc64fe-0b3d-4d17-9b55-c99b00867a18 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:47.968669 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4026830b-d80d-4778-baa4-6ee1c8241886 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:47.969365 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4026830b-d80d-4778-baa4-6ee1c8241886 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:47.976117 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4026830b-d80d-4778-baa4-6ee1c8241886 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:47.976523 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4cfc64fe-0b3d-4d17-9b55-c99b00867a18 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1709 microversion: 2.1 time: 0.150217 May 23 10:53:47.976643 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4026830b-d80d-4778-baa4-6ee1c8241886 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:47.977095 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 143/283] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:47 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:47.977315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4026830b-d80d-4778-baa4-6ee1c8241886 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:47.977792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4026830b-d80d-4778-baa4-6ee1c8241886 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:48.111388 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4026830b-d80d-4778-baa4-6ee1c8241886 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:48.118796 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4026830b-d80d-4778-baa4-6ee1c8241886 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.154254 May 23 10:53:48.119394 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 141/284] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:47 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:48.150992 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-394fcc94-3b4e-4fa8-b4f1-0b2801df23bc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:48.151623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-394fcc94-3b4e-4fa8-b4f1-0b2801df23bc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:48.157595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-394fcc94-3b4e-4fa8-b4f1-0b2801df23bc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:48.158076 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-394fcc94-3b4e-4fa8-b4f1-0b2801df23bc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:48.158847 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-394fcc94-3b4e-4fa8-b4f1-0b2801df23bc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:48.159284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-394fcc94-3b4e-4fa8-b4f1-0b2801df23bc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:48.290841 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-394fcc94-3b4e-4fa8-b4f1-0b2801df23bc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:48.298839 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-394fcc94-3b4e-4fa8-b4f1-0b2801df23bc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:48.300350 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-394fcc94-3b4e-4fa8-b4f1-0b2801df23bc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:48.301522 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-394fcc94-3b4e-4fa8-b4f1-0b2801df23bc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1720 microversion: 2.20 time: 0.154371 May 23 10:53:48.302103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 144/285] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:48 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:48.450774 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-217208b6-7da0-4a38-b630-5c34ce7668b6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:48.451292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-217208b6-7da0-4a38-b630-5c34ce7668b6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:48.457836 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-217208b6-7da0-4a38-b630-5c34ce7668b6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:48.458315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-217208b6-7da0-4a38-b630-5c34ce7668b6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:48.459075 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-217208b6-7da0-4a38-b630-5c34ce7668b6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:48.459510 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-217208b6-7da0-4a38-b630-5c34ce7668b6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:48.584553 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-217208b6-7da0-4a38-b630-5c34ce7668b6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:48.591978 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-217208b6-7da0-4a38-b630-5c34ce7668b6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.145085 May 23 10:53:48.592514 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-092d98a1-43c1-467f-9dcb-0e0fc2444223 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:48.592658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 142/286] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:48 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:48.593122 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-092d98a1-43c1-467f-9dcb-0e0fc2444223 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:48.599225 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-092d98a1-43c1-467f-9dcb-0e0fc2444223 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:48.599679 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-092d98a1-43c1-467f-9dcb-0e0fc2444223 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:48.600450 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-092d98a1-43c1-467f-9dcb-0e0fc2444223 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:48.600887 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-092d98a1-43c1-467f-9dcb-0e0fc2444223 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:48.725886 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-092d98a1-43c1-467f-9dcb-0e0fc2444223 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:48.733181 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-092d98a1-43c1-467f-9dcb-0e0fc2444223 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1315 microversion: 2.1 time: 0.144455 May 23 10:53:48.733736 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 145/287] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:48 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:48.994146 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-97f701f7-a1eb-4eb1-9934-2fbca3923005 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:48.994725 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-97f701f7-a1eb-4eb1-9934-2fbca3923005 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:49.001152 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97f701f7-a1eb-4eb1-9934-2fbca3923005 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.001600 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97f701f7-a1eb-4eb1-9934-2fbca3923005 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.002391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97f701f7-a1eb-4eb1-9934-2fbca3923005 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.002828 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97f701f7-a1eb-4eb1-9934-2fbca3923005 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.129159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-97f701f7-a1eb-4eb1-9934-2fbca3923005 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:49.135281 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b77c76bf-579e-49fe-abc7-b9458bd44579 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:49.135890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b77c76bf-579e-49fe-abc7-b9458bd44579 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:49.137081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-97f701f7-a1eb-4eb1-9934-2fbca3923005 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1709 microversion: 2.1 time: 0.146793 May 23 10:53:49.137658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 143/288] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:48 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1709 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:49.142458 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b77c76bf-579e-49fe-abc7-b9458bd44579 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.142941 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b77c76bf-579e-49fe-abc7-b9458bd44579 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.143710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b77c76bf-579e-49fe-abc7-b9458bd44579 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.144148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b77c76bf-579e-49fe-abc7-b9458bd44579 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.274035 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b77c76bf-579e-49fe-abc7-b9458bd44579 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:49.282095 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b77c76bf-579e-49fe-abc7-b9458bd44579 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.150509 May 23 10:53:49.282661 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 146/289] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:49 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:49.319086 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4d73b240-5a7f-4f67-abe1-ba235779401e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:49.319700 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4d73b240-5a7f-4f67-abe1-ba235779401e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:49.326346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4d73b240-5a7f-4f67-abe1-ba235779401e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.326796 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4d73b240-5a7f-4f67-abe1-ba235779401e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.327561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4d73b240-5a7f-4f67-abe1-ba235779401e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.328001 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4d73b240-5a7f-4f67-abe1-ba235779401e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.461842 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4d73b240-5a7f-4f67-abe1-ba235779401e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:49.469835 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4d73b240-5a7f-4f67-abe1-ba235779401e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:49.471368 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4d73b240-5a7f-4f67-abe1-ba235779401e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:49.473148 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4d73b240-5a7f-4f67-abe1-ba235779401e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1720 microversion: 2.20 time: 0.157346 May 23 10:53:49.473724 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 144/290] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:49 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:49.608513 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fd5fd9f4-23af-4249-bd47-fc97b33a21e5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:49.609125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-fd5fd9f4-23af-4249-bd47-fc97b33a21e5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:49.615270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fd5fd9f4-23af-4249-bd47-fc97b33a21e5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.615721 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fd5fd9f4-23af-4249-bd47-fc97b33a21e5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.616486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fd5fd9f4-23af-4249-bd47-fc97b33a21e5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.616922 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fd5fd9f4-23af-4249-bd47-fc97b33a21e5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.749278 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fd5fd9f4-23af-4249-bd47-fc97b33a21e5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:49.751563 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-91d10c66-39af-465e-b78e-3193dfc178de tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:49.751770 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-91d10c66-39af-465e-b78e-3193dfc178de tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:49.758154 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fd5fd9f4-23af-4249-bd47-fc97b33a21e5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.153447 May 23 10:53:49.758945 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 147/291] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:49 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:49.759057 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91d10c66-39af-465e-b78e-3193dfc178de tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.759312 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91d10c66-39af-465e-b78e-3193dfc178de tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.760211 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91d10c66-39af-465e-b78e-3193dfc178de tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.760652 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91d10c66-39af-465e-b78e-3193dfc178de tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.800990 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-20ac85b7-ef34-465d-bc0f-a241bd0d659b req-4eacc6a7-091a-48eb-94e9-9a979dfd3e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279d8cbc-fd45-48d5-b072-43ce43dd7fba", "name": "network-vif-plugged", "status": "completed", "tag": "ce7f026a-53bb-47d5-b04f-fed5afa345a9"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:49.809184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-20ac85b7-ef34-465d-bc0f-a241bd0d659b req-4eacc6a7-091a-48eb-94e9-9a979dfd3e53 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:49.809634 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-20ac85b7-ef34-465d-bc0f-a241bd0d659b req-4eacc6a7-091a-48eb-94e9-9a979dfd3e53 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:49.821243 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-20ac85b7-ef34-465d-bc0f-a241bd0d659b req-4eacc6a7-091a-48eb-94e9-9a979dfd3e53 service nova] Creating event network-vif-plugged:ce7f026a-53bb-47d5-b04f-fed5afa345a9 for instance 279d8cbc-fd45-48d5-b072-43ce43dd7fba on hv-cinder-83699 May 23 10:53:49.826339 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-20ac85b7-ef34-465d-bc0f-a241bd0d659b req-4eacc6a7-091a-48eb-94e9-9a979dfd3e53 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028875 May 23 10:53:49.826932 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 148/292] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:53:49.888628 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-91d10c66-39af-465e-b78e-3193dfc178de tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:49.896973 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-91d10c66-39af-465e-b78e-3193dfc178de tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1315 microversion: 2.1 time: 0.150393 May 23 10:53:49.897542 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 145/293] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:49 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:50.151750 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:50.152434 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=6 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:50.156909 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3eca6867-84f9-4a26-887f-e62106d6c7c2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:50.157656 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3eca6867-84f9-4a26-887f-e62106d6c7c2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:50.165385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3eca6867-84f9-4a26-887f-e62106d6c7c2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.165824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3eca6867-84f9-4a26-887f-e62106d6c7c2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.166745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3eca6867-84f9-4a26-887f-e62106d6c7c2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.167197 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3eca6867-84f9-4a26-887f-e62106d6c7c2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.299703 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2e0e4e7d-c9c7-486a-ac9f-1daac5b6c4af tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:50.300318 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2e0e4e7d-c9c7-486a-ac9f-1daac5b6c4af tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:50.303305 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:50.311776 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2e0e4e7d-c9c7-486a-ac9f-1daac5b6c4af tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.312602 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2e0e4e7d-c9c7-486a-ac9f-1daac5b6c4af tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.313539 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2e0e4e7d-c9c7-486a-ac9f-1daac5b6c4af tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.314196 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2e0e4e7d-c9c7-486a-ac9f-1daac5b6c4af tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.317147 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3eca6867-84f9-4a26-887f-e62106d6c7c2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:50.326749 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3eca6867-84f9-4a26-887f-e62106d6c7c2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1713 microversion: 2.1 time: 0.175931 May 23 10:53:50.339328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 149/294] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:50 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1713 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:50.465175 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2e0e4e7d-c9c7-486a-ac9f-1daac5b6c4af tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:50.473096 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2e0e4e7d-c9c7-486a-ac9f-1daac5b6c4af tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.176895 May 23 10:53:50.473678 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 146/295] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:50 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:50.491822 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5fe522db-7066-4497-9413-f9266424d548 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:50.492432 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5fe522db-7066-4497-9413-f9266424d548 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:50.498444 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5fe522db-7066-4497-9413-f9266424d548 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.498895 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5fe522db-7066-4497-9413-f9266424d548 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.499659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5fe522db-7066-4497-9413-f9266424d548 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.500578 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5fe522db-7066-4497-9413-f9266424d548 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.637166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5fe522db-7066-4497-9413-f9266424d548 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:50.645645 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5fe522db-7066-4497-9413-f9266424d548 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:50.647517 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5fe522db-7066-4497-9413-f9266424d548 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:50.648748 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5fe522db-7066-4497-9413-f9266424d548 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1723 microversion: 2.20 time: 0.161362 May 23 10:53:50.649439 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 150/296] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:50 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:50.667551 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-abcc35c2-5e47-4d13-bce7-7ebf25a5decc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df5f86f-57c4-4c49-8ffe-9e6010adb4dd"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:50.668699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-abcc35c2-5e47-4d13-bce7-7ebf25a5decc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:50.688550 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-abcc35c2-5e47-4d13-bce7-7ebf25a5decc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.689005 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-abcc35c2-5e47-4d13-bce7-7ebf25a5decc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.689794 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-abcc35c2-5e47-4d13-bce7-7ebf25a5decc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.690267 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-abcc35c2-5e47-4d13-bce7-7ebf25a5decc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.776226 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c29cbd10-090f-46d4-81d1-eb746cd76043 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:50.776935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c29cbd10-090f-46d4-81d1-eb746cd76043 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:50.789840 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c29cbd10-090f-46d4-81d1-eb746cd76043 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.790397 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c29cbd10-090f-46d4-81d1-eb746cd76043 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.791270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c29cbd10-090f-46d4-81d1-eb746cd76043 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.791790 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c29cbd10-090f-46d4-81d1-eb746cd76043 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.927275 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c29cbd10-090f-46d4-81d1-eb746cd76043 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:50.934916 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c29cbd10-090f-46d4-81d1-eb746cd76043 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.163155 May 23 10:53:50.935482 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 151/297] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:50 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:50.940327 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-53d489ba-24fc-4aa3-a75f-df3d4cf579c3 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:50.941101 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-53d489ba-24fc-4aa3-a75f-df3d4cf579c3 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:50.947063 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-53d489ba-24fc-4aa3-a75f-df3d4cf579c3 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.947515 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-53d489ba-24fc-4aa3-a75f-df3d4cf579c3 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.948287 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-53d489ba-24fc-4aa3-a75f-df3d4cf579c3 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:50.948725 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-53d489ba-24fc-4aa3-a75f-df3d4cf579c3 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:50.983546 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-abcc35c2-5e47-4d13-bce7-7ebf25a5decc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "POST /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319990 May 23 10:53:50.984392 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 147/298] 10.222.0.36 () {62 vars in 1363 bytes} [Mon May 23 10:53:50 2022] POST /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-volume_attachments => generated 188 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:53:51.085481 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-53d489ba-24fc-4aa3-a75f-df3d4cf579c3 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:51.093235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-53d489ba-24fc-4aa3-a75f-df3d4cf579c3 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1315 microversion: 2.1 time: 0.156485 May 23 10:53:51.093791 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 152/299] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:50 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:51.107336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-054502ca-660a-4263-a952-9a6943b22c1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:51.107929 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-054502ca-660a-4263-a952-9a6943b22c1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:51.114547 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-054502ca-660a-4263-a952-9a6943b22c1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:51.114994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-054502ca-660a-4263-a952-9a6943b22c1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:51.115759 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-054502ca-660a-4263-a952-9a6943b22c1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:51.116191 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-054502ca-660a-4263-a952-9a6943b22c1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:51.209473 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-054502ca-660a-4263-a952-9a6943b22c1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "POST /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/action" status: 202 len: 0 microversion: 2.20 time: 0.106114 May 23 10:53:51.210115 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 148/300] 10.222.0.36 () {62 vars in 1318 bytes} [Mon May 23 10:53:51 2022] POST /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 10:53:51.218053 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-77704499-821c-4658-a5b1-61a42ea50cc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:51.218666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-77704499-821c-4658-a5b1-61a42ea50cc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:51.225095 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77704499-821c-4658-a5b1-61a42ea50cc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:51.225553 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77704499-821c-4658-a5b1-61a42ea50cc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:51.226352 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77704499-821c-4658-a5b1-61a42ea50cc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:51.226795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77704499-821c-4658-a5b1-61a42ea50cc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:51.365908 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-77704499-821c-4658-a5b1-61a42ea50cc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:51.369335 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:51.375359 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-77704499-821c-4658-a5b1-61a42ea50cc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:51.376863 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-77704499-821c-4658-a5b1-61a42ea50cc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:51.378066 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-77704499-821c-4658-a5b1-61a42ea50cc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1749 microversion: 2.20 time: 0.163841 May 23 10:53:51.379156 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 153/301] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:51 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:51.490790 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-91fe5eea-c27e-48c6-9931-e84a89a120f1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:51.491396 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-91fe5eea-c27e-48c6-9931-e84a89a120f1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:51.497234 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91fe5eea-c27e-48c6-9931-e84a89a120f1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:51.497674 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91fe5eea-c27e-48c6-9931-e84a89a120f1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:51.498454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91fe5eea-c27e-48c6-9931-e84a89a120f1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:51.498891 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91fe5eea-c27e-48c6-9931-e84a89a120f1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:51.641440 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-91fe5eea-c27e-48c6-9931-e84a89a120f1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:51.649282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-91fe5eea-c27e-48c6-9931-e84a89a120f1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.163325 May 23 10:53:51.649852 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 149/302] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:51 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:51.952220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6f055ea9-191b-4be3-acc2-69ea9745204d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:51.952890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6f055ea9-191b-4be3-acc2-69ea9745204d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:51.960066 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f055ea9-191b-4be3-acc2-69ea9745204d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:51.960457 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f055ea9-191b-4be3-acc2-69ea9745204d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:51.961231 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f055ea9-191b-4be3-acc2-69ea9745204d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:51.961676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f055ea9-191b-4be3-acc2-69ea9745204d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:52.091755 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6f055ea9-191b-4be3-acc2-69ea9745204d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:52.099466 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6f055ea9-191b-4be3-acc2-69ea9745204d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.151579 May 23 10:53:52.100106 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 154/303] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:51 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:52.113529 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d422707f-84c4-4204-afb1-ae46d64c05ac tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:52.114167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d422707f-84c4-4204-afb1-ae46d64c05ac tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:52.120082 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d422707f-84c4-4204-afb1-ae46d64c05ac tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:52.120524 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d422707f-84c4-4204-afb1-ae46d64c05ac tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:52.121278 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d422707f-84c4-4204-afb1-ae46d64c05ac tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:52.121709 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d422707f-84c4-4204-afb1-ae46d64c05ac tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:52.260271 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d422707f-84c4-4204-afb1-ae46d64c05ac tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:52.267621 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d422707f-84c4-4204-afb1-ae46d64c05ac tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1315 microversion: 2.1 time: 0.157882 May 23 10:53:52.268190 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 150/304] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:52 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:52.396804 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a94d85e8-2432-42cf-8ca4-fef22e03a388 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:52.397405 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a94d85e8-2432-42cf-8ca4-fef22e03a388 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:52.403975 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a94d85e8-2432-42cf-8ca4-fef22e03a388 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:52.404428 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a94d85e8-2432-42cf-8ca4-fef22e03a388 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:52.405196 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a94d85e8-2432-42cf-8ca4-fef22e03a388 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:52.405634 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a94d85e8-2432-42cf-8ca4-fef22e03a388 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:52.535222 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a94d85e8-2432-42cf-8ca4-fef22e03a388 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:52.543492 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a94d85e8-2432-42cf-8ca4-fef22e03a388 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:52.544970 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a94d85e8-2432-42cf-8ca4-fef22e03a388 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:52.546153 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a94d85e8-2432-42cf-8ca4-fef22e03a388 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1749 microversion: 2.20 time: 0.153498 May 23 10:53:52.546710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 155/305] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:52 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:52.665349 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-be691ab7-9b58-4a7c-ae1f-538f07733774 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:52.665972 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-be691ab7-9b58-4a7c-ae1f-538f07733774 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:52.668277 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:52.673897 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-be691ab7-9b58-4a7c-ae1f-538f07733774 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:52.674371 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-be691ab7-9b58-4a7c-ae1f-538f07733774 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:52.675143 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-be691ab7-9b58-4a7c-ae1f-538f07733774 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:52.676202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-be691ab7-9b58-4a7c-ae1f-538f07733774 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:52.727149 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=14 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:52.806726 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-be691ab7-9b58-4a7c-ae1f-538f07733774 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:52.814154 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-be691ab7-9b58-4a7c-ae1f-538f07733774 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.152549 May 23 10:53:52.814725 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 151/306] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:52 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:53.115971 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fa3bb054-896c-468e-9c2e-91577f27c82f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:53.116578 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-fa3bb054-896c-468e-9c2e-91577f27c82f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:53.122585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa3bb054-896c-468e-9c2e-91577f27c82f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.123031 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa3bb054-896c-468e-9c2e-91577f27c82f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.123790 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa3bb054-896c-468e-9c2e-91577f27c82f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.124224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa3bb054-896c-468e-9c2e-91577f27c82f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.247721 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fa3bb054-896c-468e-9c2e-91577f27c82f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:53.255088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fa3bb054-896c-468e-9c2e-91577f27c82f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.142933 May 23 10:53:53.255643 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 156/307] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:53 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:53.284402 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-81837766-0839-466b-afc8-947ba28fc44b tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:53.285625 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-81837766-0839-466b-afc8-947ba28fc44b tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:53.291649 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-81837766-0839-466b-afc8-947ba28fc44b tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.292088 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-81837766-0839-466b-afc8-947ba28fc44b tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.292836 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-81837766-0839-466b-afc8-947ba28fc44b tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.293265 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-81837766-0839-466b-afc8-947ba28fc44b tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.310330 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:53.452497 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-81837766-0839-466b-afc8-947ba28fc44b tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:53.460490 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-81837766-0839-466b-afc8-947ba28fc44b tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1464 microversion: 2.1 time: 0.179863 May 23 10:53:53.461142 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 152/308] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:53 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:53.499661 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e6157140-0910-4c12-8db3-1c0f342e1118 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:53.500405 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e6157140-0910-4c12-8db3-1c0f342e1118 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:53.507746 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e6157140-0910-4c12-8db3-1c0f342e1118 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.508263 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e6157140-0910-4c12-8db3-1c0f342e1118 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.509097 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e6157140-0910-4c12-8db3-1c0f342e1118 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.509603 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e6157140-0910-4c12-8db3-1c0f342e1118 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.535485 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e6157140-0910-4c12-8db3-1c0f342e1118 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:53:53.565166 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3ff380d0-993d-48a3-aa69-f9938f3d7cd7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:53.565931 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3ff380d0-993d-48a3-aa69-f9938f3d7cd7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:53.579431 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3ff380d0-993d-48a3-aa69-f9938f3d7cd7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.579891 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3ff380d0-993d-48a3-aa69-f9938f3d7cd7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.580681 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3ff380d0-993d-48a3-aa69-f9938f3d7cd7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.581115 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3ff380d0-993d-48a3-aa69-f9938f3d7cd7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.619151 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e6157140-0910-4c12-8db3-1c0f342e1118 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "DELETE /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 204 len: 0 microversion: 2.1 time: 0.123083 May 23 10:53:53.621541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 157/309] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:53:53 2022] DELETE /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:53:53.635438 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9f060abc-cd61-4f00-a413-62dbce3a4ffd tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:53.636310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9f060abc-cd61-4f00-a413-62dbce3a4ffd tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:53.648562 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f060abc-cd61-4f00-a413-62dbce3a4ffd tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.649921 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f060abc-cd61-4f00-a413-62dbce3a4ffd tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.651469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f060abc-cd61-4f00-a413-62dbce3a4ffd tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.652045 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f060abc-cd61-4f00-a413-62dbce3a4ffd tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.752499 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3ff380d0-993d-48a3-aa69-f9938f3d7cd7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:53.762932 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3ff380d0-993d-48a3-aa69-f9938f3d7cd7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:53.764696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3ff380d0-993d-48a3-aa69-f9938f3d7cd7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:53.765884 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3ff380d0-993d-48a3-aa69-f9938f3d7cd7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1751 microversion: 2.20 time: 0.205081 May 23 10:53:53.766475 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 153/310] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:53 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:53.794228 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9f060abc-cd61-4f00-a413-62dbce3a4ffd tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:53.802263 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9f060abc-cd61-4f00-a413-62dbce3a4ffd tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1470 microversion: 2.1 time: 0.176428 May 23 10:53:53.802837 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 158/311] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:53 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:53.830727 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-90bfe055-6f59-4840-b3db-19a5e4e49125 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:53.831557 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-90bfe055-6f59-4840-b3db-19a5e4e49125 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:53.837535 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90bfe055-6f59-4840-b3db-19a5e4e49125 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.838091 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90bfe055-6f59-4840-b3db-19a5e4e49125 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.838927 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90bfe055-6f59-4840-b3db-19a5e4e49125 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:53.839456 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90bfe055-6f59-4840-b3db-19a5e4e49125 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:53.967223 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-90bfe055-6f59-4840-b3db-19a5e4e49125 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:53.974652 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-90bfe055-6f59-4840-b3db-19a5e4e49125 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.147711 May 23 10:53:53.975218 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 154/312] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:53 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:54.272230 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-7b789360-0680-42fb-821d-d23ab60bd016 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:54.272860 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-7b789360-0680-42fb-821d-d23ab60bd016 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:54.278883 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7b789360-0680-42fb-821d-d23ab60bd016 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:54.279327 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7b789360-0680-42fb-821d-d23ab60bd016 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:54.280078 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7b789360-0680-42fb-821d-d23ab60bd016 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:54.280514 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7b789360-0680-42fb-821d-d23ab60bd016 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:54.407043 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-7b789360-0680-42fb-821d-d23ab60bd016 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:54.415037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-7b789360-0680-42fb-821d-d23ab60bd016 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.146813 May 23 10:53:54.415612 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 159/313] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:54 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:54.784493 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4b0fc00a-cab4-41a1-ac67-772d745b48da tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:54.785636 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4b0fc00a-cab4-41a1-ac67-772d745b48da tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:54.792215 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4b0fc00a-cab4-41a1-ac67-772d745b48da tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:54.792659 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4b0fc00a-cab4-41a1-ac67-772d745b48da tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:54.793418 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4b0fc00a-cab4-41a1-ac67-772d745b48da tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:54.793853 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4b0fc00a-cab4-41a1-ac67-772d745b48da tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:54.819094 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-66241719-ca6f-40df-a0c2-74604e2672b8 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:54.819689 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-66241719-ca6f-40df-a0c2-74604e2672b8 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:54.826320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-66241719-ca6f-40df-a0c2-74604e2672b8 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:54.826742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-66241719-ca6f-40df-a0c2-74604e2672b8 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:54.827346 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-66241719-ca6f-40df-a0c2-74604e2672b8 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:54.827745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-66241719-ca6f-40df-a0c2-74604e2672b8 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:54.923099 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4b0fc00a-cab4-41a1-ac67-772d745b48da tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:54.931543 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4b0fc00a-cab4-41a1-ac67-772d745b48da tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:54.933039 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4b0fc00a-cab4-41a1-ac67-772d745b48da tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:54.934224 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4b0fc00a-cab4-41a1-ac67-772d745b48da tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1751 microversion: 2.20 time: 0.153623 May 23 10:53:54.934791 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 155/314] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:54 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:54.959487 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-66241719-ca6f-40df-a0c2-74604e2672b8 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:54.966820 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-66241719-ca6f-40df-a0c2-74604e2672b8 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1470 microversion: 2.1 time: 0.151472 May 23 10:53:54.967376 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 160/315] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:54 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:54.990992 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e3345c30-6a31-4c73-a5b4-762b352c1b86 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:54.991879 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e3345c30-6a31-4c73-a5b4-762b352c1b86 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:54.998148 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e3345c30-6a31-4c73-a5b4-762b352c1b86 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:54.998590 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e3345c30-6a31-4c73-a5b4-762b352c1b86 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:54.999344 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e3345c30-6a31-4c73-a5b4-762b352c1b86 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:54.999773 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e3345c30-6a31-4c73-a5b4-762b352c1b86 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:55.131005 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e3345c30-6a31-4c73-a5b4-762b352c1b86 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:55.138801 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e3345c30-6a31-4c73-a5b4-762b352c1b86 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.151514 May 23 10:53:55.139372 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 156/316] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:54 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:55.431830 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e1e831a6-1ef0-4849-8c1f-7ea45bd7a4e3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:55.432340 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e1e831a6-1ef0-4849-8c1f-7ea45bd7a4e3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:55.438411 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e1e831a6-1ef0-4849-8c1f-7ea45bd7a4e3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:55.438871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e1e831a6-1ef0-4849-8c1f-7ea45bd7a4e3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:55.439603 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e1e831a6-1ef0-4849-8c1f-7ea45bd7a4e3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:55.440030 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e1e831a6-1ef0-4849-8c1f-7ea45bd7a4e3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:55.572385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e1e831a6-1ef0-4849-8c1f-7ea45bd7a4e3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:55.580247 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e1e831a6-1ef0-4849-8c1f-7ea45bd7a4e3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.152275 May 23 10:53:55.581084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 161/317] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:55 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:55.730246 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-4de1eb80-3a59-4f84-b2c0-617904906459 req-4cdf868b-2c4e-4471-bf8a-976d946e8bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1671c4-e70e-4431-88d7-9ea12615aa07", "name": "network-vif-plugged", "status": "completed", "tag": "09d7f930-a93b-4df0-9ea7-29ea518e1743"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:55.740335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-4de1eb80-3a59-4f84-b2c0-617904906459 req-4cdf868b-2c4e-4471-bf8a-976d946e8bfc service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:55.740932 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-4de1eb80-3a59-4f84-b2c0-617904906459 req-4cdf868b-2c4e-4471-bf8a-976d946e8bfc service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:55.752918 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-4de1eb80-3a59-4f84-b2c0-617904906459 req-4cdf868b-2c4e-4471-bf8a-976d946e8bfc service nova] Creating event network-vif-plugged:09d7f930-a93b-4df0-9ea7-29ea518e1743 for instance fc1671c4-e70e-4431-88d7-9ea12615aa07 on hv-cinder-83699 May 23 10:53:55.758172 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-4de1eb80-3a59-4f84-b2c0-617904906459 req-4cdf868b-2c4e-4471-bf8a-976d946e8bfc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031819 May 23 10:53:55.758822 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 157/318] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:55.953439 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c8d2244a-7d81-46c5-87ea-c79a5c75eab2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:55.953439 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c8d2244a-7d81-46c5-87ea-c79a5c75eab2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:55.959864 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c8d2244a-7d81-46c5-87ea-c79a5c75eab2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:55.960313 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c8d2244a-7d81-46c5-87ea-c79a5c75eab2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:55.961089 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c8d2244a-7d81-46c5-87ea-c79a5c75eab2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:55.961708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c8d2244a-7d81-46c5-87ea-c79a5c75eab2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:55.985097 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e084fe78-cd3f-469e-9ded-0f118d00a3b7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:55.986839 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e084fe78-cd3f-469e-9ded-0f118d00a3b7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:55.993730 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e084fe78-cd3f-469e-9ded-0f118d00a3b7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:55.994303 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e084fe78-cd3f-469e-9ded-0f118d00a3b7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:55.995166 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e084fe78-cd3f-469e-9ded-0f118d00a3b7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:55.995851 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e084fe78-cd3f-469e-9ded-0f118d00a3b7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:56.104712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c8d2244a-7d81-46c5-87ea-c79a5c75eab2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:56.116254 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c8d2244a-7d81-46c5-87ea-c79a5c75eab2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:56.117920 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c8d2244a-7d81-46c5-87ea-c79a5c75eab2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:56.119288 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c8d2244a-7d81-46c5-87ea-c79a5c75eab2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.171011 May 23 10:53:56.120066 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 162/319] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:55 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:56.156642 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e8bef309-02d1-4b78-ad33-34802dd93bc4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:56.157246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e8bef309-02d1-4b78-ad33-34802dd93bc4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:56.164942 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e8bef309-02d1-4b78-ad33-34802dd93bc4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:56.165526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e8bef309-02d1-4b78-ad33-34802dd93bc4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:56.166415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e8bef309-02d1-4b78-ad33-34802dd93bc4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:56.166915 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e8bef309-02d1-4b78-ad33-34802dd93bc4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:56.327951 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e084fe78-cd3f-469e-9ded-0f118d00a3b7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:56.349673 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e084fe78-cd3f-469e-9ded-0f118d00a3b7 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1470 microversion: 2.1 time: 0.369267 May 23 10:53:56.350983 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 158/320] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:55 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:56.373688 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e8bef309-02d1-4b78-ad33-34802dd93bc4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:56.382913 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e8bef309-02d1-4b78-ad33-34802dd93bc4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.230192 May 23 10:53:56.383711 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 163/321] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:56 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:56.518798 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-33a2cdc0-e271-4ea9-af67-1aedfcb688b6 req-8141ee11-e719-431c-a837-64bc08d57c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279d8cbc-fd45-48d5-b072-43ce43dd7fba", "name": "network-vif-deleted", "tag": "ce7f026a-53bb-47d5-b04f-fed5afa345a9"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:56.528149 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-33a2cdc0-e271-4ea9-af67-1aedfcb688b6 req-8141ee11-e719-431c-a837-64bc08d57c0d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:56.528589 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-33a2cdc0-e271-4ea9-af67-1aedfcb688b6 req-8141ee11-e719-431c-a837-64bc08d57c0d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:56.540440 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-33a2cdc0-e271-4ea9-af67-1aedfcb688b6 req-8141ee11-e719-431c-a837-64bc08d57c0d service nova] Creating event network-vif-deleted:ce7f026a-53bb-47d5-b04f-fed5afa345a9 for instance 279d8cbc-fd45-48d5-b072-43ce43dd7fba on hv-cinder-83699 May 23 10:53:56.545402 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-33a2cdc0-e271-4ea9-af67-1aedfcb688b6 req-8141ee11-e719-431c-a837-64bc08d57c0d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030256 May 23 10:53:56.546039 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 159/322] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:56.596705 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c3920a23-718b-41b2-9815-b147d4d5dbfd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:56.597306 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c3920a23-718b-41b2-9815-b147d4d5dbfd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:56.603403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c3920a23-718b-41b2-9815-b147d4d5dbfd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:56.603844 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c3920a23-718b-41b2-9815-b147d4d5dbfd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:56.604591 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c3920a23-718b-41b2-9815-b147d4d5dbfd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:56.605019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c3920a23-718b-41b2-9815-b147d4d5dbfd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:56.738109 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c3920a23-718b-41b2-9815-b147d4d5dbfd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:56.746759 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c3920a23-718b-41b2-9815-b147d4d5dbfd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.153759 May 23 10:53:56.747260 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 164/323] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:56 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:57.138036 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6ddcc670-e642-4747-9818-9ba5d107a14c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:57.138730 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6ddcc670-e642-4747-9818-9ba5d107a14c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:57.144961 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ddcc670-e642-4747-9818-9ba5d107a14c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:57.145680 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ddcc670-e642-4747-9818-9ba5d107a14c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:57.146467 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ddcc670-e642-4747-9818-9ba5d107a14c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:57.146904 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ddcc670-e642-4747-9818-9ba5d107a14c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:57.311978 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6ddcc670-e642-4747-9818-9ba5d107a14c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:57.320464 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6ddcc670-e642-4747-9818-9ba5d107a14c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:57.322020 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6ddcc670-e642-4747-9818-9ba5d107a14c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:57.323188 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6ddcc670-e642-4747-9818-9ba5d107a14c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.189925 May 23 10:53:57.323769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 160/324] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:57 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:57.368363 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:57.369056 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:57.375700 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:57.376150 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:57.376920 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:57.377358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:57.399999 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-14941227-53b1-48e2-9518-f0482454228a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:57.400729 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-14941227-53b1-48e2-9518-f0482454228a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:57.406823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-14941227-53b1-48e2-9518-f0482454228a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:57.407345 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-14941227-53b1-48e2-9518-f0482454228a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:57.407499 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:57.407865 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:57.408310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lazy-loading 'fault' on Instance uuid 279d8cbc-fd45-48d5-b072-43ce43dd7fba {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:53:57.408417 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-14941227-53b1-48e2-9518-f0482454228a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:57.408894 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-14941227-53b1-48e2-9518-f0482454228a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:57.451415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d08a3e6fe47d7a29a991a44498eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67f4759ef6a47b888079e98fee54fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:57.459255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d6a71671-c722-4b5e-b21d-00755183b8b6 tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 200 len: 1305 microversion: 2.1 time: 0.094637 May 23 10:53:57.459826 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 165/325] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:57 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:57.538714 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-14941227-53b1-48e2-9518-f0482454228a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:57.546632 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-14941227-53b1-48e2-9518-f0482454228a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1366 microversion: 2.1 time: 0.150572 May 23 10:53:57.547408 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 161/326] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:57 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:53:57.765924 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-45b3edba-7598-4849-9fff-4c01c3baa71c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:57.766560 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-45b3edba-7598-4849-9fff-4c01c3baa71c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:57.773846 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-45b3edba-7598-4849-9fff-4c01c3baa71c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:57.774325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-45b3edba-7598-4849-9fff-4c01c3baa71c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:57.775089 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-45b3edba-7598-4849-9fff-4c01c3baa71c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:57.775523 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-45b3edba-7598-4849-9fff-4c01c3baa71c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:57.903245 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-45b3edba-7598-4849-9fff-4c01c3baa71c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:57.910508 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-45b3edba-7598-4849-9fff-4c01c3baa71c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.149299 May 23 10:53:57.911063 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 166/327] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:57 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:58.341987 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b74e1160-543d-4a6c-bf08-88af8effedc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:58.343571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b74e1160-543d-4a6c-bf08-88af8effedc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:58.352514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b74e1160-543d-4a6c-bf08-88af8effedc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:58.353970 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b74e1160-543d-4a6c-bf08-88af8effedc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:58.355100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b74e1160-543d-4a6c-bf08-88af8effedc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:58.355701 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b74e1160-543d-4a6c-bf08-88af8effedc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:58.476766 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2f3a7f4b-c83b-4776-8fdc-46137f67877f tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:58.477455 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2f3a7f4b-c83b-4776-8fdc-46137f67877f tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] [instance: 279d8cbc-fd45-48d5-b072-43ce43dd7fba] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:58.484192 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2f3a7f4b-c83b-4776-8fdc-46137f67877f tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:58.484916 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2f3a7f4b-c83b-4776-8fdc-46137f67877f tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:58.485720 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2f3a7f4b-c83b-4776-8fdc-46137f67877f tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:58.486215 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2f3a7f4b-c83b-4776-8fdc-46137f67877f tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:58.500684 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-2f3a7f4b-c83b-4776-8fdc-46137f67877f tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] HTTP exception thrown: Instance 279d8cbc-fd45-48d5-b072-43ce43dd7fba could not be found. May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2f3a7f4b-c83b-4776-8fdc-46137f67877f tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Request method failure captured: May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba HTTP/1.1 May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2exLYmdAAeN_h_dbO6kJi8GB4JRayPVOfiUO4VXv5xmVIb9IzddfUL7Mj_FEUYukWE4J-8wB5tNmMVNr0z-c47ryDxHFdUuGxLDwrYXMWm85Msw8OdGKMu1Xmd8brxJfbMEb9eHX-L2vxuBuKRmJ3yl4tM5ZptCsdPjXG-YPZOHRm4 May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: b67f4759ef6a47b888079e98fee54fa3 May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesNegativeTest-986141610 May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:53:58.502383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b67f4759ef6a47b888079e98fee54fa3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b67f4759ef6a47b888079e98fee54fa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b67f4759ef6a47b888079e98fee54fa3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b67f4759ef6a47b888079e98fee54fa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesNegativeTest-986141610 May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: b67f4759ef6a47b888079e98fee54fa3 May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesNegativeTest-986141610 May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesNegativeTest-986141610-project May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: e35d08a3e6fe47d7a29a991a44498eaa May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesNegativeTest-986141610-project May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 279d8cbc-fd45-48d5-b072-43ce43dd7fba could not be found. May 23 10:53:58.503881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '279d8cbc-fd45-48d5-b072-43ce43dd7fba'} May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279d8cbc-fd45-48d5-b072-43ce43dd7fba could not be found. May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:53:58.505320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279d8cbc-fd45-48d5-b072-43ce43dd7fba could not be found. May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279d8cbc-fd45-48d5-b072-43ce43dd7fba could not be found. May 23 10:53:58.506742 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:53:58.508082 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2f3a7f4b-c83b-4776-8fdc-46137f67877f tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] Returning 404 to user: Instance 279d8cbc-fd45-48d5-b072-43ce43dd7fba could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:53:58.508082 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2f3a7f4b-c83b-4776-8fdc-46137f67877f tempest-VolumesNegativeTest-986141610 tempest-VolumesNegativeTest-986141610-project] 10.222.0.36 "GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba" status: 404 len: 111 microversion: 2.1 time: 0.031318 May 23 10:53:58.508082 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 167/328] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:58 2022] GET /compute/v2.1/servers/279d8cbc-fd45-48d5-b072-43ce43dd7fba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 10:53:58.508304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b74e1160-543d-4a6c-bf08-88af8effedc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:58.517049 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b74e1160-543d-4a6c-bf08-88af8effedc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:58.518628 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b74e1160-543d-4a6c-bf08-88af8effedc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:58.519740 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b74e1160-543d-4a6c-bf08-88af8effedc9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.183029 May 23 10:53:58.520564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 162/329] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:58 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:58.565785 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fa47e676-0189-4ca3-9cd9-c74205f1e24d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:58.566528 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-fa47e676-0189-4ca3-9cd9-c74205f1e24d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:58.573520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa47e676-0189-4ca3-9cd9-c74205f1e24d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:58.574057 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa47e676-0189-4ca3-9cd9-c74205f1e24d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:58.574881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa47e676-0189-4ca3-9cd9-c74205f1e24d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:58.575393 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa47e676-0189-4ca3-9cd9-c74205f1e24d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:58.710985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fa47e676-0189-4ca3-9cd9-c74205f1e24d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:58.718487 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fa47e676-0189-4ca3-9cd9-c74205f1e24d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1555 microversion: 2.1 time: 0.158972 May 23 10:53:58.719143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 168/330] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:58 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:58.735419 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bfee8e20-c492-4a49-81e7-8e6828be428f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:58.735988 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-bfee8e20-c492-4a49-81e7-8e6828be428f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:58.742836 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bfee8e20-c492-4a49-81e7-8e6828be428f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:58.743296 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bfee8e20-c492-4a49-81e7-8e6828be428f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:58.744070 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bfee8e20-c492-4a49-81e7-8e6828be428f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:58.744511 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bfee8e20-c492-4a49-81e7-8e6828be428f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:58.820156 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-bfee8e20-c492-4a49-81e7-8e6828be428f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088966 May 23 10:53:58.820790 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 163/331] 10.222.0.36 () {58 vars in 1274 bytes} [Mon May 23 10:53:58 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:53:58.927939 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-65166053-8a7e-4f73-b976-b407ca7f5c26 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:58.928432 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-65166053-8a7e-4f73-b976-b407ca7f5c26 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:58.934875 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-65166053-8a7e-4f73-b976-b407ca7f5c26 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:58.935316 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-65166053-8a7e-4f73-b976-b407ca7f5c26 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:58.936082 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-65166053-8a7e-4f73-b976-b407ca7f5c26 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:58.936510 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-65166053-8a7e-4f73-b976-b407ca7f5c26 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:58.940625 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:53:59.080298 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-65166053-8a7e-4f73-b976-b407ca7f5c26 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:59.093713 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-65166053-8a7e-4f73-b976-b407ca7f5c26 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.170533 May 23 10:53:59.094311 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 169/332] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:53:58 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:53:59.548528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5490a89e-d584-47c0-a477-c2def0b43875 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:53:59.549295 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5490a89e-d584-47c0-a477-c2def0b43875 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:53:59.561908 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5490a89e-d584-47c0-a477-c2def0b43875 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:59.562396 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5490a89e-d584-47c0-a477-c2def0b43875 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:59.563363 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5490a89e-d584-47c0-a477-c2def0b43875 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:59.564362 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5490a89e-d584-47c0-a477-c2def0b43875 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:53:59.809442 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5490a89e-d584-47c0-a477-c2def0b43875 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:59.821222 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5490a89e-d584-47c0-a477-c2def0b43875 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:59.823198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5490a89e-d584-47c0-a477-c2def0b43875 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:53:59.824391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5490a89e-d584-47c0-a477-c2def0b43875 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.286972 May 23 10:53:59.824950 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 164/333] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:53:59 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:53:59.984769 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-8dfce752-f429-4c79-8f19-9fa708e5a830 req-794ef3b8-0f9b-45f2-95ce-faaa017f8a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1671c4-e70e-4431-88d7-9ea12615aa07", "tag": "09d7f930-a93b-4df0-9ea7-29ea518e1743"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:53:59.995617 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-8dfce752-f429-4c79-8f19-9fa708e5a830 req-794ef3b8-0f9b-45f2-95ce-faaa017f8a61 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:53:59.996296 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-8dfce752-f429-4c79-8f19-9fa708e5a830 req-794ef3b8-0f9b-45f2-95ce-faaa017f8a61 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:00.014556 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-8dfce752-f429-4c79-8f19-9fa708e5a830 req-794ef3b8-0f9b-45f2-95ce-faaa017f8a61 service nova] Creating event network-changed:09d7f930-a93b-4df0-9ea7-29ea518e1743 for instance fc1671c4-e70e-4431-88d7-9ea12615aa07 on hv-cinder-83699 May 23 10:54:00.023022 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-8dfce752-f429-4c79-8f19-9fa708e5a830 req-794ef3b8-0f9b-45f2-95ce-faaa017f8a61 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042621 May 23 10:54:00.023779 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 170/334] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:54:00.111303 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0479de18-8f61-47f0-aed3-7d5746631e2b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:00.112057 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0479de18-8f61-47f0-aed3-7d5746631e2b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:00.126630 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0479de18-8f61-47f0-aed3-7d5746631e2b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:00.128530 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0479de18-8f61-47f0-aed3-7d5746631e2b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:00.129578 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0479de18-8f61-47f0-aed3-7d5746631e2b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:00.131348 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0479de18-8f61-47f0-aed3-7d5746631e2b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:00.342903 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0479de18-8f61-47f0-aed3-7d5746631e2b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:00.352737 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0479de18-8f61-47f0-aed3-7d5746631e2b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.244268 May 23 10:54:00.353899 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 165/335] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:00 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:00.843989 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4b359735-bef2-4319-bdde-c0cf128cc7c6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:00.844869 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-4b359735-bef2-4319-bdde-c0cf128cc7c6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:00.855082 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4b359735-bef2-4319-bdde-c0cf128cc7c6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:00.855764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4b359735-bef2-4319-bdde-c0cf128cc7c6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:00.856819 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4b359735-bef2-4319-bdde-c0cf128cc7c6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:00.857557 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4b359735-bef2-4319-bdde-c0cf128cc7c6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:01.069242 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-4b359735-bef2-4319-bdde-c0cf128cc7c6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:01.081044 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-4b359735-bef2-4319-bdde-c0cf128cc7c6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:01.082871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-4b359735-bef2-4319-bdde-c0cf128cc7c6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:01.084243 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4b359735-bef2-4319-bdde-c0cf128cc7c6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.245227 May 23 10:54:01.106161 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 171/336] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:00 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:01.376255 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-99ee2ae5-fc1b-4183-bf26-895281b39907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:01.377158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-99ee2ae5-fc1b-4183-bf26-895281b39907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:01.389319 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-99ee2ae5-fc1b-4183-bf26-895281b39907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:01.394319 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-99ee2ae5-fc1b-4183-bf26-895281b39907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:01.396390 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-99ee2ae5-fc1b-4183-bf26-895281b39907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:01.396942 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-99ee2ae5-fc1b-4183-bf26-895281b39907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:01.615795 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-99ee2ae5-fc1b-4183-bf26-895281b39907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:01.639339 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-99ee2ae5-fc1b-4183-bf26-895281b39907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.271052 May 23 10:54:01.640583 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 166/337] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:01 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:02.112873 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c3a489a3-fb21-4615-a92f-c96df7b0c253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:02.114154 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c3a489a3-fb21-4615-a92f-c96df7b0c253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:02.120310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c3a489a3-fb21-4615-a92f-c96df7b0c253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:02.120732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c3a489a3-fb21-4615-a92f-c96df7b0c253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:02.121494 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c3a489a3-fb21-4615-a92f-c96df7b0c253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:02.121930 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c3a489a3-fb21-4615-a92f-c96df7b0c253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:02.278273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c3a489a3-fb21-4615-a92f-c96df7b0c253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:02.288463 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c3a489a3-fb21-4615-a92f-c96df7b0c253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:02.290218 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c3a489a3-fb21-4615-a92f-c96df7b0c253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:02.291375 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c3a489a3-fb21-4615-a92f-c96df7b0c253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.182731 May 23 10:54:02.291956 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 172/338] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:02 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:02.656565 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-58356d11-ba27-4f04-bf3a-412094df24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:02.657177 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-58356d11-ba27-4f04-bf3a-412094df24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:02.664824 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-58356d11-ba27-4f04-bf3a-412094df24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:02.665304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-58356d11-ba27-4f04-bf3a-412094df24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:02.666126 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-58356d11-ba27-4f04-bf3a-412094df24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:02.666569 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-58356d11-ba27-4f04-bf3a-412094df24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:02.803313 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-58356d11-ba27-4f04-bf3a-412094df24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:02.811394 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-58356d11-ba27-4f04-bf3a-412094df24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.158622 May 23 10:54:02.820688 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 167/339] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:02 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:03.318691 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2c3855a9-1633-4b92-8ad1-2341fc08f763 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:03.319301 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2c3855a9-1633-4b92-8ad1-2341fc08f763 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:03.325975 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2c3855a9-1633-4b92-8ad1-2341fc08f763 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:03.326643 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2c3855a9-1633-4b92-8ad1-2341fc08f763 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:03.327563 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2c3855a9-1633-4b92-8ad1-2341fc08f763 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:03.328149 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2c3855a9-1633-4b92-8ad1-2341fc08f763 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:03.524129 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2c3855a9-1633-4b92-8ad1-2341fc08f763 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:03.540895 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2c3855a9-1633-4b92-8ad1-2341fc08f763 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:03.543879 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2c3855a9-1633-4b92-8ad1-2341fc08f763 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:03.545196 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2c3855a9-1633-4b92-8ad1-2341fc08f763 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.239058 May 23 10:54:03.546340 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 173/340] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:03 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:03.828454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3c8f92f3-b137-4c21-8eb8-80be035d24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:03.829159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3c8f92f3-b137-4c21-8eb8-80be035d24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:03.836987 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3c8f92f3-b137-4c21-8eb8-80be035d24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:03.837445 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3c8f92f3-b137-4c21-8eb8-80be035d24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:03.838321 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3c8f92f3-b137-4c21-8eb8-80be035d24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:03.838761 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3c8f92f3-b137-4c21-8eb8-80be035d24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:04.002386 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3c8f92f3-b137-4c21-8eb8-80be035d24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:04.015235 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3c8f92f3-b137-4c21-8eb8-80be035d24ea tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.190595 May 23 10:54:04.016762 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 168/341] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:03 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:04.563818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-58abbcf3-786c-42db-afc8-0c3e86587375 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:04.564429 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-58abbcf3-786c-42db-afc8-0c3e86587375 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:04.571735 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-58abbcf3-786c-42db-afc8-0c3e86587375 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:04.572226 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-58abbcf3-786c-42db-afc8-0c3e86587375 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:04.573018 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-58abbcf3-786c-42db-afc8-0c3e86587375 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:04.573459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-58abbcf3-786c-42db-afc8-0c3e86587375 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:04.735845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-58abbcf3-786c-42db-afc8-0c3e86587375 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:04.745666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-58abbcf3-786c-42db-afc8-0c3e86587375 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:04.747508 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-58abbcf3-786c-42db-afc8-0c3e86587375 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:04.749010 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-58abbcf3-786c-42db-afc8-0c3e86587375 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.189176 May 23 10:54:04.749567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 174/342] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:04 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:05.032753 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2c7ff441-4197-475b-a8c9-e048210307b1 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:05.033424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2c7ff441-4197-475b-a8c9-e048210307b1 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:05.040430 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2c7ff441-4197-475b-a8c9-e048210307b1 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:05.040875 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2c7ff441-4197-475b-a8c9-e048210307b1 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:05.041640 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2c7ff441-4197-475b-a8c9-e048210307b1 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:05.042141 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2c7ff441-4197-475b-a8c9-e048210307b1 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:05.176309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2c7ff441-4197-475b-a8c9-e048210307b1 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:05.184921 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2c7ff441-4197-475b-a8c9-e048210307b1 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.156103 May 23 10:54:05.185494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 169/343] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:05 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:05.768400 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bbe75644-c86b-44d8-9d26-53c1ce2ce0d4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:05.769655 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bbe75644-c86b-44d8-9d26-53c1ce2ce0d4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:05.777010 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bbe75644-c86b-44d8-9d26-53c1ce2ce0d4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:05.777686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bbe75644-c86b-44d8-9d26-53c1ce2ce0d4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:05.778518 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bbe75644-c86b-44d8-9d26-53c1ce2ce0d4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:05.778957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bbe75644-c86b-44d8-9d26-53c1ce2ce0d4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:05.936891 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bbe75644-c86b-44d8-9d26-53c1ce2ce0d4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:05.946741 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bbe75644-c86b-44d8-9d26-53c1ce2ce0d4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:05.952631 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bbe75644-c86b-44d8-9d26-53c1ce2ce0d4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:05.955881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bbe75644-c86b-44d8-9d26-53c1ce2ce0d4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.191404 May 23 10:54:05.956458 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 175/344] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:05 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:06.202247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e07626ea-f197-48ad-8028-3e41c391fce8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:06.202975 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e07626ea-f197-48ad-8028-3e41c391fce8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:06.211674 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e07626ea-f197-48ad-8028-3e41c391fce8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:06.212127 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e07626ea-f197-48ad-8028-3e41c391fce8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:06.212892 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e07626ea-f197-48ad-8028-3e41c391fce8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:06.213507 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e07626ea-f197-48ad-8028-3e41c391fce8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:06.355177 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e07626ea-f197-48ad-8028-3e41c391fce8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:06.358766 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=100 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:06.367955 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e07626ea-f197-48ad-8028-3e41c391fce8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.170362 May 23 10:54:06.368537 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 170/345] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:06 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:06.975092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-7add1596-2905-4a6e-8a91-e9441bb08d60 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:06.975752 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-7add1596-2905-4a6e-8a91-e9441bb08d60 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:06.982585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7add1596-2905-4a6e-8a91-e9441bb08d60 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:06.983361 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7add1596-2905-4a6e-8a91-e9441bb08d60 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:06.984200 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7add1596-2905-4a6e-8a91-e9441bb08d60 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:06.984699 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7add1596-2905-4a6e-8a91-e9441bb08d60 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:07.122909 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-7add1596-2905-4a6e-8a91-e9441bb08d60 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:07.131316 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-7add1596-2905-4a6e-8a91-e9441bb08d60 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:07.132808 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-7add1596-2905-4a6e-8a91-e9441bb08d60 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:07.133965 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-7add1596-2905-4a6e-8a91-e9441bb08d60 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.163396 May 23 10:54:07.134523 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 176/346] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:06 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:07.385181 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1588e35a-e3bf-4bc7-b23d-cbac4546245a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:07.385779 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1588e35a-e3bf-4bc7-b23d-cbac4546245a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:07.392637 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1588e35a-e3bf-4bc7-b23d-cbac4546245a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:07.393089 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1588e35a-e3bf-4bc7-b23d-cbac4546245a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:07.393862 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1588e35a-e3bf-4bc7-b23d-cbac4546245a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:07.394825 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1588e35a-e3bf-4bc7-b23d-cbac4546245a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:07.533477 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1588e35a-e3bf-4bc7-b23d-cbac4546245a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:07.541701 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1588e35a-e3bf-4bc7-b23d-cbac4546245a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.160470 May 23 10:54:07.542350 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 171/347] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:07 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:08.151877 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-00bdb131-7a20-4e52-b0b1-6e6c2a1f4b88 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:08.152604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-00bdb131-7a20-4e52-b0b1-6e6c2a1f4b88 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:08.159418 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-00bdb131-7a20-4e52-b0b1-6e6c2a1f4b88 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:08.159945 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-00bdb131-7a20-4e52-b0b1-6e6c2a1f4b88 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:08.160781 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-00bdb131-7a20-4e52-b0b1-6e6c2a1f4b88 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:08.161254 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-00bdb131-7a20-4e52-b0b1-6e6c2a1f4b88 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:08.305064 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-00bdb131-7a20-4e52-b0b1-6e6c2a1f4b88 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:08.313934 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-00bdb131-7a20-4e52-b0b1-6e6c2a1f4b88 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:08.315746 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-00bdb131-7a20-4e52-b0b1-6e6c2a1f4b88 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:08.317477 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-00bdb131-7a20-4e52-b0b1-6e6c2a1f4b88 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.169450 May 23 10:54:08.318052 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 177/348] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:08 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:08.558541 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3742158d-2c07-413c-8810-b9e729875d72 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:08.559322 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3742158d-2c07-413c-8810-b9e729875d72 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:08.566744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3742158d-2c07-413c-8810-b9e729875d72 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:08.567295 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3742158d-2c07-413c-8810-b9e729875d72 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:08.568193 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3742158d-2c07-413c-8810-b9e729875d72 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:08.568703 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3742158d-2c07-413c-8810-b9e729875d72 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:08.724549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3742158d-2c07-413c-8810-b9e729875d72 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:08.733086 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3742158d-2c07-413c-8810-b9e729875d72 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.178322 May 23 10:54:08.733880 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 172/349] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:08 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:09.335668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-28b459a6-bd03-4b84-b707-80094b7c31fa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:09.336293 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-28b459a6-bd03-4b84-b707-80094b7c31fa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:09.338732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:09.343905 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-28b459a6-bd03-4b84-b707-80094b7c31fa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:09.344353 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-28b459a6-bd03-4b84-b707-80094b7c31fa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:09.345111 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-28b459a6-bd03-4b84-b707-80094b7c31fa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:09.345549 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-28b459a6-bd03-4b84-b707-80094b7c31fa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:09.480740 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-28b459a6-bd03-4b84-b707-80094b7c31fa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:09.489562 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-28b459a6-bd03-4b84-b707-80094b7c31fa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:09.491101 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-28b459a6-bd03-4b84-b707-80094b7c31fa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:09.492259 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-28b459a6-bd03-4b84-b707-80094b7c31fa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.161219 May 23 10:54:09.492812 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 178/350] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:09 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:09.749996 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6786da30-1123-4435-ad8d-c674a2e85c47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:09.750552 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6786da30-1123-4435-ad8d-c674a2e85c47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:09.757772 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6786da30-1123-4435-ad8d-c674a2e85c47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:09.758403 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6786da30-1123-4435-ad8d-c674a2e85c47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:09.759172 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6786da30-1123-4435-ad8d-c674a2e85c47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:09.759612 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6786da30-1123-4435-ad8d-c674a2e85c47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:09.888298 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6786da30-1123-4435-ad8d-c674a2e85c47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:09.896022 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6786da30-1123-4435-ad8d-c674a2e85c47 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.149969 May 23 10:54:09.896592 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 173/351] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:09 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:10.510372 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-70b75a1e-f846-4859-a8d7-defc30374344 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:10.510904 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-70b75a1e-f846-4859-a8d7-defc30374344 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:10.517163 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-70b75a1e-f846-4859-a8d7-defc30374344 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:10.517606 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-70b75a1e-f846-4859-a8d7-defc30374344 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:10.518383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-70b75a1e-f846-4859-a8d7-defc30374344 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:10.518816 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-70b75a1e-f846-4859-a8d7-defc30374344 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:10.644134 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-70b75a1e-f846-4859-a8d7-defc30374344 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:10.653324 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-70b75a1e-f846-4859-a8d7-defc30374344 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:10.654874 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-70b75a1e-f846-4859-a8d7-defc30374344 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:10.656030 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-70b75a1e-f846-4859-a8d7-defc30374344 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.149573 May 23 10:54:10.656579 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 179/352] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:10 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:10.911848 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-eeac8c47-bd2a-4d1f-b0d1-519eb5112a8b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:10.912454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-eeac8c47-bd2a-4d1f-b0d1-519eb5112a8b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:10.918902 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-eeac8c47-bd2a-4d1f-b0d1-519eb5112a8b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:10.919347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-eeac8c47-bd2a-4d1f-b0d1-519eb5112a8b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:10.920100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-eeac8c47-bd2a-4d1f-b0d1-519eb5112a8b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:10.920524 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-eeac8c47-bd2a-4d1f-b0d1-519eb5112a8b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:11.047417 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-eeac8c47-bd2a-4d1f-b0d1-519eb5112a8b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:11.055611 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-eeac8c47-bd2a-4d1f-b0d1-519eb5112a8b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.147506 May 23 10:54:11.056238 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 174/353] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:10 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:11.674265 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-47a0a672-50e0-415c-9b16-b395f45f015f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:11.674875 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-47a0a672-50e0-415c-9b16-b395f45f015f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:11.682160 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47a0a672-50e0-415c-9b16-b395f45f015f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:11.682613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47a0a672-50e0-415c-9b16-b395f45f015f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:11.683379 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47a0a672-50e0-415c-9b16-b395f45f015f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:11.683848 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47a0a672-50e0-415c-9b16-b395f45f015f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:11.811435 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-47a0a672-50e0-415c-9b16-b395f45f015f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:11.819677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-47a0a672-50e0-415c-9b16-b395f45f015f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:11.821169 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-47a0a672-50e0-415c-9b16-b395f45f015f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:11.822347 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-47a0a672-50e0-415c-9b16-b395f45f015f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.151968 May 23 10:54:11.822905 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 180/354] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:11 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:12.072469 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-aece9cf7-d116-4216-bdb1-d58c0267785a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:12.073085 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-aece9cf7-d116-4216-bdb1-d58c0267785a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:12.079551 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aece9cf7-d116-4216-bdb1-d58c0267785a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:12.080001 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aece9cf7-d116-4216-bdb1-d58c0267785a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:12.080770 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aece9cf7-d116-4216-bdb1-d58c0267785a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:12.081208 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aece9cf7-d116-4216-bdb1-d58c0267785a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:12.206129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aece9cf7-d116-4216-bdb1-d58c0267785a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:12.214140 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-aece9cf7-d116-4216-bdb1-d58c0267785a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.145504 May 23 10:54:12.214712 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 175/355] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:12 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:12.840948 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ba3d7bcb-886d-4fea-9534-6e1452041a8e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:12.841551 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ba3d7bcb-886d-4fea-9534-6e1452041a8e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:12.848609 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ba3d7bcb-886d-4fea-9534-6e1452041a8e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:12.849057 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ba3d7bcb-886d-4fea-9534-6e1452041a8e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:12.849827 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ba3d7bcb-886d-4fea-9534-6e1452041a8e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:12.850288 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ba3d7bcb-886d-4fea-9534-6e1452041a8e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:12.974555 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ba3d7bcb-886d-4fea-9534-6e1452041a8e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:12.982850 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ba3d7bcb-886d-4fea-9534-6e1452041a8e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:12.984342 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ba3d7bcb-886d-4fea-9534-6e1452041a8e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:12.985531 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ba3d7bcb-886d-4fea-9534-6e1452041a8e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.148443 May 23 10:54:12.986127 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 181/356] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:12 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:13.231350 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a403951e-1645-4c5a-81fe-788db026ac92 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:13.231866 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a403951e-1645-4c5a-81fe-788db026ac92 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:13.238567 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a403951e-1645-4c5a-81fe-788db026ac92 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:13.239015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a403951e-1645-4c5a-81fe-788db026ac92 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:13.239783 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a403951e-1645-4c5a-81fe-788db026ac92 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:13.240216 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a403951e-1645-4c5a-81fe-788db026ac92 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:13.366203 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a403951e-1645-4c5a-81fe-788db026ac92 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:13.373592 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a403951e-1645-4c5a-81fe-788db026ac92 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1520 microversion: 2.1 time: 0.146163 May 23 10:54:13.374181 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 176/357] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:13 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:14.004973 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5846af2f-e52e-4100-91f6-7984e350e665 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:14.005581 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5846af2f-e52e-4100-91f6-7984e350e665 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:14.011992 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5846af2f-e52e-4100-91f6-7984e350e665 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:14.012441 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5846af2f-e52e-4100-91f6-7984e350e665 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:14.013198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5846af2f-e52e-4100-91f6-7984e350e665 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:14.013631 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5846af2f-e52e-4100-91f6-7984e350e665 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:14.137763 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5846af2f-e52e-4100-91f6-7984e350e665 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:14.146375 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5846af2f-e52e-4100-91f6-7984e350e665 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:14.147844 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5846af2f-e52e-4100-91f6-7984e350e665 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:14.148974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5846af2f-e52e-4100-91f6-7984e350e665 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.148530 May 23 10:54:14.149536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 182/358] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:13 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:14.390127 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-25d5e330-d5b1-46eb-be10-f22374d8410c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:14.390736 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-25d5e330-d5b1-46eb-be10-f22374d8410c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:14.397404 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-25d5e330-d5b1-46eb-be10-f22374d8410c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:14.397859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-25d5e330-d5b1-46eb-be10-f22374d8410c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:14.398645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-25d5e330-d5b1-46eb-be10-f22374d8410c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:14.399079 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-25d5e330-d5b1-46eb-be10-f22374d8410c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:14.822679 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-25d5e330-d5b1-46eb-be10-f22374d8410c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:14.830075 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-25d5e330-d5b1-46eb-be10-f22374d8410c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1500 microversion: 2.1 time: 0.443768 May 23 10:54:14.830651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 177/359] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:14 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1500 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:14.845990 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-dac5c30c-3f25-4e82-b8b0-66a5161228c2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:14.846688 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-dac5c30c-3f25-4e82-b8b0-66a5161228c2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:14.853610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-dac5c30c-3f25-4e82-b8b0-66a5161228c2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:14.854105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-dac5c30c-3f25-4e82-b8b0-66a5161228c2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:14.854893 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-dac5c30c-3f25-4e82-b8b0-66a5161228c2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:14.855334 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-dac5c30c-3f25-4e82-b8b0-66a5161228c2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:14.983554 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-dac5c30c-3f25-4e82-b8b0-66a5161228c2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:14.991214 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-dac5c30c-3f25-4e82-b8b0-66a5161228c2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1516 microversion: 2.1 time: 0.149044 May 23 10:54:14.991786 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 183/360] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:14 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:15.167075 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e8780f8e-3bb9-498d-9152-8641dad609c3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:15.167674 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e8780f8e-3bb9-498d-9152-8641dad609c3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:15.174251 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8780f8e-3bb9-498d-9152-8641dad609c3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:15.174752 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8780f8e-3bb9-498d-9152-8641dad609c3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:15.175539 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8780f8e-3bb9-498d-9152-8641dad609c3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:15.175968 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8780f8e-3bb9-498d-9152-8641dad609c3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:15.342101 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e8780f8e-3bb9-498d-9152-8641dad609c3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:15.351376 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e8780f8e-3bb9-498d-9152-8641dad609c3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:15.352861 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e8780f8e-3bb9-498d-9152-8641dad609c3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:15.354170 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e8780f8e-3bb9-498d-9152-8641dad609c3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.191226 May 23 10:54:15.354728 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 178/361] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:15 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:16.373477 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2102860d-ef79-4b87-9c6b-1ad2a1234b80 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:16.374112 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2102860d-ef79-4b87-9c6b-1ad2a1234b80 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:16.380651 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2102860d-ef79-4b87-9c6b-1ad2a1234b80 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:16.381111 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2102860d-ef79-4b87-9c6b-1ad2a1234b80 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:16.381876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2102860d-ef79-4b87-9c6b-1ad2a1234b80 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:16.382341 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2102860d-ef79-4b87-9c6b-1ad2a1234b80 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:16.508681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2102860d-ef79-4b87-9c6b-1ad2a1234b80 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:16.516937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2102860d-ef79-4b87-9c6b-1ad2a1234b80 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:16.518471 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2102860d-ef79-4b87-9c6b-1ad2a1234b80 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:16.520128 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2102860d-ef79-4b87-9c6b-1ad2a1234b80 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.150563 May 23 10:54:16.520943 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 184/362] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:16 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:17.539509 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b342f0d6-9b0f-4eba-ad8a-17eaa19b4c89 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:17.540131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b342f0d6-9b0f-4eba-ad8a-17eaa19b4c89 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:17.546701 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b342f0d6-9b0f-4eba-ad8a-17eaa19b4c89 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:17.547136 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b342f0d6-9b0f-4eba-ad8a-17eaa19b4c89 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:17.547887 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b342f0d6-9b0f-4eba-ad8a-17eaa19b4c89 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:17.548317 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b342f0d6-9b0f-4eba-ad8a-17eaa19b4c89 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:17.678323 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b342f0d6-9b0f-4eba-ad8a-17eaa19b4c89 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:17.686626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b342f0d6-9b0f-4eba-ad8a-17eaa19b4c89 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:17.688112 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b342f0d6-9b0f-4eba-ad8a-17eaa19b4c89 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:17.689650 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b342f0d6-9b0f-4eba-ad8a-17eaa19b4c89 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.154281 May 23 10:54:17.689801 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 179/363] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:17 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:18.433692 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-738b3797-4528-4cdb-9cab-b124567232f8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:18.434771 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-738b3797-4528-4cdb-9cab-b124567232f8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:18.441755 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-738b3797-4528-4cdb-9cab-b124567232f8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:18.442232 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-738b3797-4528-4cdb-9cab-b124567232f8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:18.442995 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-738b3797-4528-4cdb-9cab-b124567232f8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:18.443433 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-738b3797-4528-4cdb-9cab-b124567232f8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:18.465431 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-738b3797-4528-4cdb-9cab-b124567232f8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lazy-loading 'flavor' on Instance uuid d05d0a5e-e6bc-4234-b354-9792304bc88b {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:54:18.489349 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:18.535084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-738b3797-4528-4cdb-9cab-b124567232f8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b/action" status: 200 len: 32 microversion: 2.1 time: 0.105159 May 23 10:54:18.535709 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 185/364] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 10:54:18 2022] POST /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b/action => generated 32 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 10:54:18.544848 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8149ed32-988d-4079-ba46-cbe390fa199e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:18.545464 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8149ed32-988d-4079-ba46-cbe390fa199e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:18.552585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8149ed32-988d-4079-ba46-cbe390fa199e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:18.553082 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8149ed32-988d-4079-ba46-cbe390fa199e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:18.553845 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8149ed32-988d-4079-ba46-cbe390fa199e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:18.554290 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8149ed32-988d-4079-ba46-cbe390fa199e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:18.707834 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ac87119c-2239-4203-8f79-a248c54fbdf2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:18.708648 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ac87119c-2239-4203-8f79-a248c54fbdf2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:18.714837 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ac87119c-2239-4203-8f79-a248c54fbdf2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:18.715294 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ac87119c-2239-4203-8f79-a248c54fbdf2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:18.716559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ac87119c-2239-4203-8f79-a248c54fbdf2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:18.716559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ac87119c-2239-4203-8f79-a248c54fbdf2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:18.769108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8149ed32-988d-4079-ba46-cbe390fa199e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:18.779120 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8149ed32-988d-4079-ba46-cbe390fa199e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.237979 May 23 10:54:18.779820 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 180/365] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:18 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:18.873120 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ac87119c-2239-4203-8f79-a248c54fbdf2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:18.883199 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ac87119c-2239-4203-8f79-a248c54fbdf2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:18.884725 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ac87119c-2239-4203-8f79-a248c54fbdf2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:18.885897 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ac87119c-2239-4203-8f79-a248c54fbdf2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.182432 May 23 10:54:18.886505 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 186/366] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:18 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:54:19.797023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-36d2a5a4-a95b-4d2b-89dd-35160f927956 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:19.797638 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-36d2a5a4-a95b-4d2b-89dd-35160f927956 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:19.804165 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-36d2a5a4-a95b-4d2b-89dd-35160f927956 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:19.804616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-36d2a5a4-a95b-4d2b-89dd-35160f927956 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:19.805383 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-36d2a5a4-a95b-4d2b-89dd-35160f927956 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:19.805823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-36d2a5a4-a95b-4d2b-89dd-35160f927956 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:19.904428 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c55c22ff-0488-4438-85dd-a6e3578b1769 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:19.905031 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c55c22ff-0488-4438-85dd-a6e3578b1769 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:19.911450 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c55c22ff-0488-4438-85dd-a6e3578b1769 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:19.911904 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c55c22ff-0488-4438-85dd-a6e3578b1769 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:19.912678 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c55c22ff-0488-4438-85dd-a6e3578b1769 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:19.913117 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c55c22ff-0488-4438-85dd-a6e3578b1769 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:19.938438 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-36d2a5a4-a95b-4d2b-89dd-35160f927956 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:19.948090 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-36d2a5a4-a95b-4d2b-89dd-35160f927956 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.154877 May 23 10:54:19.949323 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 181/367] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:19 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:20.055866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c55c22ff-0488-4438-85dd-a6e3578b1769 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:20.064489 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c55c22ff-0488-4438-85dd-a6e3578b1769 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:20.066644 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c55c22ff-0488-4438-85dd-a6e3578b1769 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:20.067830 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c55c22ff-0488-4438-85dd-a6e3578b1769 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.167240 May 23 10:54:20.068386 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 187/368] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:19 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:54:20.965695 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b3bb7b02-e9a3-40f9-b0f2-71f2e0b9e817 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:20.966351 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b3bb7b02-e9a3-40f9-b0f2-71f2e0b9e817 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:20.968676 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=74 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:20.974494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b3bb7b02-e9a3-40f9-b0f2-71f2e0b9e817 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:20.974955 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b3bb7b02-e9a3-40f9-b0f2-71f2e0b9e817 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:20.975721 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b3bb7b02-e9a3-40f9-b0f2-71f2e0b9e817 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:20.976180 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b3bb7b02-e9a3-40f9-b0f2-71f2e0b9e817 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:21.086940 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ae901fda-b21a-4535-925c-2dde8ed2e7a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:21.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ae901fda-b21a-4535-925c-2dde8ed2e7a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:21.094258 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ae901fda-b21a-4535-925c-2dde8ed2e7a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:21.094727 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ae901fda-b21a-4535-925c-2dde8ed2e7a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:21.095590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ae901fda-b21a-4535-925c-2dde8ed2e7a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:21.096103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ae901fda-b21a-4535-925c-2dde8ed2e7a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:21.103461 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b3bb7b02-e9a3-40f9-b0f2-71f2e0b9e817 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:21.112630 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b3bb7b02-e9a3-40f9-b0f2-71f2e0b9e817 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.150882 May 23 10:54:21.113400 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 182/369] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:20 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:21.224784 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ae901fda-b21a-4535-925c-2dde8ed2e7a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:21.233326 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ae901fda-b21a-4535-925c-2dde8ed2e7a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:21.234852 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ae901fda-b21a-4535-925c-2dde8ed2e7a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:21.236011 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ae901fda-b21a-4535-925c-2dde8ed2e7a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.153799 May 23 10:54:21.236568 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 188/370] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:21 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:54:22.128564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bb32c5e8-4d48-44b9-bf45-33e09d7a91d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:22.129085 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-bb32c5e8-4d48-44b9-bf45-33e09d7a91d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:22.136038 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bb32c5e8-4d48-44b9-bf45-33e09d7a91d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:22.136481 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bb32c5e8-4d48-44b9-bf45-33e09d7a91d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:22.137239 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bb32c5e8-4d48-44b9-bf45-33e09d7a91d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:22.137670 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bb32c5e8-4d48-44b9-bf45-33e09d7a91d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:22.254648 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-348b9eed-7d8d-4c46-9a0f-6cafaa4fab55 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:22.255818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-348b9eed-7d8d-4c46-9a0f-6cafaa4fab55 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:22.262380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-348b9eed-7d8d-4c46-9a0f-6cafaa4fab55 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:22.262831 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-348b9eed-7d8d-4c46-9a0f-6cafaa4fab55 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:22.263863 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-348b9eed-7d8d-4c46-9a0f-6cafaa4fab55 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:22.264385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-348b9eed-7d8d-4c46-9a0f-6cafaa4fab55 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:22.269530 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-bb32c5e8-4d48-44b9-bf45-33e09d7a91d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:22.277252 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-bb32c5e8-4d48-44b9-bf45-33e09d7a91d9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.152611 May 23 10:54:22.277825 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 183/371] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:22 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:22.391073 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-348b9eed-7d8d-4c46-9a0f-6cafaa4fab55 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:22.399774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-348b9eed-7d8d-4c46-9a0f-6cafaa4fab55 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:22.401560 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-348b9eed-7d8d-4c46-9a0f-6cafaa4fab55 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:22.402726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-348b9eed-7d8d-4c46-9a0f-6cafaa4fab55 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.151942 May 23 10:54:22.403467 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 189/372] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:22 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:54:23.293926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-028db825-07a5-447f-9200-36c977b13ae0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:23.294560 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-028db825-07a5-447f-9200-36c977b13ae0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:23.301065 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-028db825-07a5-447f-9200-36c977b13ae0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:23.301511 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-028db825-07a5-447f-9200-36c977b13ae0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:23.302328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-028db825-07a5-447f-9200-36c977b13ae0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:23.302761 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-028db825-07a5-447f-9200-36c977b13ae0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:23.420660 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ef8bfff1-97c4-4034-9f44-a90f6adc3fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:23.421229 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ef8bfff1-97c4-4034-9f44-a90f6adc3fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:23.427707 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ef8bfff1-97c4-4034-9f44-a90f6adc3fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:23.428152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ef8bfff1-97c4-4034-9f44-a90f6adc3fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:23.428910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ef8bfff1-97c4-4034-9f44-a90f6adc3fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:23.429393 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ef8bfff1-97c4-4034-9f44-a90f6adc3fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:23.430470 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-028db825-07a5-447f-9200-36c977b13ae0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:23.438165 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-028db825-07a5-447f-9200-36c977b13ae0 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.147883 May 23 10:54:23.438822 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 184/373] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:23 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:23.562129 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ef8bfff1-97c4-4034-9f44-a90f6adc3fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:23.570962 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ef8bfff1-97c4-4034-9f44-a90f6adc3fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:23.572449 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ef8bfff1-97c4-4034-9f44-a90f6adc3fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:23.573601 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ef8bfff1-97c4-4034-9f44-a90f6adc3fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.156849 May 23 10:54:23.574195 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 190/374] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:23 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:54:23.829719 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-79efe335-470f-4e12-8389-a917d7dd4458 req-4555b2f9-2719-4de0-bbb5-55cfb58b5c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61941d-0058-4809-83b9-676d70df112a", "name": "network-vif-plugged", "status": "completed", "tag": "5b53bf83-661d-4063-8ac0-99bf4069b7ab"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:23.839148 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-79efe335-470f-4e12-8389-a917d7dd4458 req-4555b2f9-2719-4de0-bbb5-55cfb58b5c78 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:23.839657 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-79efe335-470f-4e12-8389-a917d7dd4458 req-4555b2f9-2719-4de0-bbb5-55cfb58b5c78 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:23.853264 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-79efe335-470f-4e12-8389-a917d7dd4458 req-4555b2f9-2719-4de0-bbb5-55cfb58b5c78 service nova] Creating event network-vif-plugged:5b53bf83-661d-4063-8ac0-99bf4069b7ab for instance 1e61941d-0058-4809-83b9-676d70df112a on hv-cinder-83699 May 23 10:54:23.858492 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-79efe335-470f-4e12-8389-a917d7dd4458 req-4555b2f9-2719-4de0-bbb5-55cfb58b5c78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032735 May 23 10:54:23.859088 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 185/375] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:54:24.456052 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e365e688-b17a-46e0-8e51-1290d6364d29 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:24.456641 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e365e688-b17a-46e0-8e51-1290d6364d29 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:24.463983 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e365e688-b17a-46e0-8e51-1290d6364d29 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:24.464506 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e365e688-b17a-46e0-8e51-1290d6364d29 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:24.465347 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e365e688-b17a-46e0-8e51-1290d6364d29 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:24.465818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e365e688-b17a-46e0-8e51-1290d6364d29 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:24.594496 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4900a90d-39ff-46c6-ab75-56b68b975f9f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:24.595407 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4900a90d-39ff-46c6-ab75-56b68b975f9f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:24.603674 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4900a90d-39ff-46c6-ab75-56b68b975f9f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:24.604277 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4900a90d-39ff-46c6-ab75-56b68b975f9f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:24.605160 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4900a90d-39ff-46c6-ab75-56b68b975f9f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:24.605666 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4900a90d-39ff-46c6-ab75-56b68b975f9f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:24.757466 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4900a90d-39ff-46c6-ab75-56b68b975f9f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:24.766335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4900a90d-39ff-46c6-ab75-56b68b975f9f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:24.767979 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4900a90d-39ff-46c6-ab75-56b68b975f9f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:24.769244 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4900a90d-39ff-46c6-ab75-56b68b975f9f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.180423 May 23 10:54:24.769909 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 186/376] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:24 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:24.837184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e365e688-b17a-46e0-8e51-1290d6364d29 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:24.844551 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e365e688-b17a-46e0-8e51-1290d6364d29 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.393042 May 23 10:54:24.845111 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 191/377] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:24 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:25.788229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-732d7771-d693-4a18-84bb-055cbf198519 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:25.788838 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-732d7771-d693-4a18-84bb-055cbf198519 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:25.795379 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-732d7771-d693-4a18-84bb-055cbf198519 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:25.795836 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-732d7771-d693-4a18-84bb-055cbf198519 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:25.796598 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-732d7771-d693-4a18-84bb-055cbf198519 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:25.797040 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-732d7771-d693-4a18-84bb-055cbf198519 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:25.862080 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-93c76765-f6f9-4c31-b302-7c0276ab4752 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:25.862686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-93c76765-f6f9-4c31-b302-7c0276ab4752 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:25.869724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-93c76765-f6f9-4c31-b302-7c0276ab4752 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:25.870214 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-93c76765-f6f9-4c31-b302-7c0276ab4752 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:25.871296 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-93c76765-f6f9-4c31-b302-7c0276ab4752 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:25.871743 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-93c76765-f6f9-4c31-b302-7c0276ab4752 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:25.931614 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-732d7771-d693-4a18-84bb-055cbf198519 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:25.940045 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-732d7771-d693-4a18-84bb-055cbf198519 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:25.941537 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-732d7771-d693-4a18-84bb-055cbf198519 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:25.942710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-732d7771-d693-4a18-84bb-055cbf198519 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.158939 May 23 10:54:25.943272 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 187/378] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:25 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:26.002799 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-93c76765-f6f9-4c31-b302-7c0276ab4752 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:26.010162 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-93c76765-f6f9-4c31-b302-7c0276ab4752 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.151912 May 23 10:54:26.010721 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 192/379] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:25 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:54:26.960626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-931efef7-d150-43bc-8deb-dfc340384851 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:26.961223 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-931efef7-d150-43bc-8deb-dfc340384851 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:26.967246 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-931efef7-d150-43bc-8deb-dfc340384851 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:26.967687 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-931efef7-d150-43bc-8deb-dfc340384851 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:26.969128 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-931efef7-d150-43bc-8deb-dfc340384851 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:26.969565 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-931efef7-d150-43bc-8deb-dfc340384851 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:26.973584 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=100 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:27.028271 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-011fc3e2-99a7-43d1-aa30-f4036dad81b2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:27.028788 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-011fc3e2-99a7-43d1-aa30-f4036dad81b2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:27.036590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-011fc3e2-99a7-43d1-aa30-f4036dad81b2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:27.037823 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-011fc3e2-99a7-43d1-aa30-f4036dad81b2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:27.038647 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-011fc3e2-99a7-43d1-aa30-f4036dad81b2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:27.039444 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-011fc3e2-99a7-43d1-aa30-f4036dad81b2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:27.110865 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-931efef7-d150-43bc-8deb-dfc340384851 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:27.120882 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-931efef7-d150-43bc-8deb-dfc340384851 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:27.122831 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-931efef7-d150-43bc-8deb-dfc340384851 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:27.124265 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-931efef7-d150-43bc-8deb-dfc340384851 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1807 microversion: 2.20 time: 0.167526 May 23 10:54:27.125119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 188/380] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:26 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:27.189890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-011fc3e2-99a7-43d1-aa30-f4036dad81b2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:27.197337 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-011fc3e2-99a7-43d1-aa30-f4036dad81b2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.174230 May 23 10:54:27.197897 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 193/381] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:27 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:54:28.142846 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5b9c315a-344e-482c-8d74-998bac561f1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:28.143455 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5b9c315a-344e-482c-8d74-998bac561f1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:28.150715 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5b9c315a-344e-482c-8d74-998bac561f1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:28.151156 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5b9c315a-344e-482c-8d74-998bac561f1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:28.151912 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5b9c315a-344e-482c-8d74-998bac561f1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:28.152341 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5b9c315a-344e-482c-8d74-998bac561f1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:28.214720 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-db645826-fafe-40d3-902f-6c6f2155c3de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:28.215325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-db645826-fafe-40d3-902f-6c6f2155c3de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:28.221738 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-db645826-fafe-40d3-902f-6c6f2155c3de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:28.222217 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-db645826-fafe-40d3-902f-6c6f2155c3de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:28.222989 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-db645826-fafe-40d3-902f-6c6f2155c3de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:28.223425 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-db645826-fafe-40d3-902f-6c6f2155c3de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:28.280754 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5b9c315a-344e-482c-8d74-998bac561f1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:28.290348 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5b9c315a-344e-482c-8d74-998bac561f1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:28.291881 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5b9c315a-344e-482c-8d74-998bac561f1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:28.293074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5b9c315a-344e-482c-8d74-998bac561f1f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1794 microversion: 2.20 time: 0.154103 May 23 10:54:28.293622 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 189/382] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:54:28 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:54:28.351207 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-db645826-fafe-40d3-902f-6c6f2155c3de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:28.358596 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-db645826-fafe-40d3-902f-6c6f2155c3de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.147762 May 23 10:54:28.359157 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 194/383] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:28 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:29.375264 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-afb99506-5027-45b1-a218-c7c9375cbe63 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:29.375875 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-afb99506-5027-45b1-a218-c7c9375cbe63 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:29.383050 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-afb99506-5027-45b1-a218-c7c9375cbe63 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:29.383501 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-afb99506-5027-45b1-a218-c7c9375cbe63 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:29.384261 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-afb99506-5027-45b1-a218-c7c9375cbe63 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:29.384693 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-afb99506-5027-45b1-a218-c7c9375cbe63 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:29.521218 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-afb99506-5027-45b1-a218-c7c9375cbe63 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:29.529130 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-afb99506-5027-45b1-a218-c7c9375cbe63 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.157673 May 23 10:54:29.529692 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 190/384] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:29 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:54:30.545768 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8d3e6888-9919-46ff-afe0-2b05a9587094 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:30.546406 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-8d3e6888-9919-46ff-afe0-2b05a9587094 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:30.552985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8d3e6888-9919-46ff-afe0-2b05a9587094 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:30.553438 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8d3e6888-9919-46ff-afe0-2b05a9587094 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:30.554229 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8d3e6888-9919-46ff-afe0-2b05a9587094 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:30.554673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8d3e6888-9919-46ff-afe0-2b05a9587094 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:30.679400 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-8d3e6888-9919-46ff-afe0-2b05a9587094 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:30.686781 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-8d3e6888-9919-46ff-afe0-2b05a9587094 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.144852 May 23 10:54:30.687348 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 195/385] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:30 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:31.703370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f182e6c4-8dc3-4993-8e0a-41597988d11c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:31.703969 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f182e6c4-8dc3-4993-8e0a-41597988d11c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:31.710426 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f182e6c4-8dc3-4993-8e0a-41597988d11c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:31.710871 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f182e6c4-8dc3-4993-8e0a-41597988d11c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:31.711636 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f182e6c4-8dc3-4993-8e0a-41597988d11c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:31.712065 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f182e6c4-8dc3-4993-8e0a-41597988d11c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:31.836215 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f182e6c4-8dc3-4993-8e0a-41597988d11c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:31.843531 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f182e6c4-8dc3-4993-8e0a-41597988d11c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.144063 May 23 10:54:31.844094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 191/386] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:31 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:32.860692 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-192b4141-b54a-4fda-b50f-064f85da21d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:32.861299 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-192b4141-b54a-4fda-b50f-064f85da21d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:32.868176 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-192b4141-b54a-4fda-b50f-064f85da21d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:32.868626 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-192b4141-b54a-4fda-b50f-064f85da21d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:32.869380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-192b4141-b54a-4fda-b50f-064f85da21d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:32.869814 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-192b4141-b54a-4fda-b50f-064f85da21d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:32.996415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-192b4141-b54a-4fda-b50f-064f85da21d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:33.003728 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-192b4141-b54a-4fda-b50f-064f85da21d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.146927 May 23 10:54:33.004291 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 196/387] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:32 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:34.021188 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3eb9549e-1d16-4b48-a12e-c55d739cce08 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:34.021787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3eb9549e-1d16-4b48-a12e-c55d739cce08 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:34.028938 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3eb9549e-1d16-4b48-a12e-c55d739cce08 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:34.029379 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3eb9549e-1d16-4b48-a12e-c55d739cce08 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:34.030157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3eb9549e-1d16-4b48-a12e-c55d739cce08 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:34.030589 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3eb9549e-1d16-4b48-a12e-c55d739cce08 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:34.155846 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3eb9549e-1d16-4b48-a12e-c55d739cce08 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:34.163298 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3eb9549e-1d16-4b48-a12e-c55d739cce08 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.146248 May 23 10:54:34.163872 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 192/388] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:34 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:35.180019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ae051864-a20b-4f33-a761-08afa2570ffe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:35.180630 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ae051864-a20b-4f33-a761-08afa2570ffe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:35.187287 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ae051864-a20b-4f33-a761-08afa2570ffe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:35.187739 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ae051864-a20b-4f33-a761-08afa2570ffe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:35.188507 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ae051864-a20b-4f33-a761-08afa2570ffe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:35.188944 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ae051864-a20b-4f33-a761-08afa2570ffe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:35.314634 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ae051864-a20b-4f33-a761-08afa2570ffe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:35.323047 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ae051864-a20b-4f33-a761-08afa2570ffe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.146848 May 23 10:54:35.323619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 197/389] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:35 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:36.338929 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-15afb1a5-30bc-4fae-a020-f22c731242be tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:36.339481 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-15afb1a5-30bc-4fae-a020-f22c731242be tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:36.346016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-15afb1a5-30bc-4fae-a020-f22c731242be tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:36.346475 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-15afb1a5-30bc-4fae-a020-f22c731242be tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:36.347327 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-15afb1a5-30bc-4fae-a020-f22c731242be tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:36.347769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-15afb1a5-30bc-4fae-a020-f22c731242be tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:36.471867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-15afb1a5-30bc-4fae-a020-f22c731242be tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:36.479813 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-15afb1a5-30bc-4fae-a020-f22c731242be tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.144769 May 23 10:54:36.480378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 193/390] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:36 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:37.496491 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-aa835fd0-fd87-4499-b9f4-a39d508821de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:37.497023 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-aa835fd0-fd87-4499-b9f4-a39d508821de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:37.503403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa835fd0-fd87-4499-b9f4-a39d508821de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:37.503847 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa835fd0-fd87-4499-b9f4-a39d508821de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:37.504602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa835fd0-fd87-4499-b9f4-a39d508821de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:37.505035 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa835fd0-fd87-4499-b9f4-a39d508821de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:37.634272 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-aa835fd0-fd87-4499-b9f4-a39d508821de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:37.641583 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-aa835fd0-fd87-4499-b9f4-a39d508821de tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.149037 May 23 10:54:37.642169 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 198/391] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:37 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:38.659148 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6473f7d9-5da9-4585-af74-9614f0c7927b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:38.659789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6473f7d9-5da9-4585-af74-9614f0c7927b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:38.666921 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6473f7d9-5da9-4585-af74-9614f0c7927b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:38.667371 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6473f7d9-5da9-4585-af74-9614f0c7927b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:38.668123 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6473f7d9-5da9-4585-af74-9614f0c7927b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:38.668559 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6473f7d9-5da9-4585-af74-9614f0c7927b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:38.797713 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6473f7d9-5da9-4585-af74-9614f0c7927b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:38.805099 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6473f7d9-5da9-4585-af74-9614f0c7927b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1502 microversion: 2.1 time: 0.149781 May 23 10:54:38.805668 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 194/392] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:38 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:38.821140 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c5b308d8-56f6-484f-8922-14d4869fb8f9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd4e4579-9bd2-4014-909c-09af16bba319"}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:38.822267 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c5b308d8-56f6-484f-8922-14d4869fb8f9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:38.828727 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c5b308d8-56f6-484f-8922-14d4869fb8f9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:38.829176 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c5b308d8-56f6-484f-8922-14d4869fb8f9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:38.829938 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c5b308d8-56f6-484f-8922-14d4869fb8f9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:38.830403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c5b308d8-56f6-484f-8922-14d4869fb8f9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:38.853746 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-c5b308d8-56f6-484f-8922-14d4869fb8f9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] HTTP exception thrown: Cannot 'attach_volume' instance d05d0a5e-e6bc-4234-b354-9792304bc88b while it is in vm_state rescued May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c5b308d8-56f6-484f-8922-14d4869fb8f9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Request method failure captured: May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: POST /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b/os-volume_attachments HTTP/1.1 May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 74 May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2eLhnLJl1WQHI6AQhbejgYPFTmHkdxSbb8YGQPU-jfMtBrmgOgTu6SnJpnxYF42UIG9Y970L_Xtfbn7Z694Bj4Sxalc3YSV73HRTz_zeRlmCwMmhl_7B5-C6bxvl_9ZZJTQqwCn8HXEekRlTd41SnLC_JFnHqfCQzK0qmyt8KWdAzI May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 33781de828264846b90b5cbbbeee7fe5 May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:54:38.855653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33781de828264846b90b5cbbbeee7fe5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 33781de828264846b90b5cbbbeee7fe5 May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-ServerRescueNegativeTestJSON-485230613-project May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 06f644c1c44d4dafacbd5bbdde323ff0 May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-ServerRescueNegativeTestJSON-485230613-project May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {"volumeAttachment": {"volumeId": "fd4e4579-9bd2-4014-909c-09af16bba319"}} May 23 10:54:38.857262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Cannot 'attach_volume' instance d05d0a5e-e6bc-4234-b354-9792304bc88b while it is in vm_state rescued May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'server_id': 'd05d0a5e-e6bc-4234-b354-9792304bc88b', 'body': {'volumeAttachment': {'volumeId': 'fd4e4579-9bd2-4014-909c-09af16bba319'}}} May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d05d0a5e-e6bc-4234-b354-9792304bc88b in vm_state rescued. Cannot attach_volume while the instance is in this state. May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:54:38.858138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d05d0a5e-e6bc-4234-b354-9792304bc88b while it is in vm_state rescued May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:54:38.859614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:54:38.861220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:54:38.861220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:54:38.861220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d05d0a5e-e6bc-4234-b354-9792304bc88b while it is in vm_state rescued May 23 10:54:38.861220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:54:38.861220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c5b308d8-56f6-484f-8922-14d4869fb8f9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Returning 409 to user: Cannot 'attach_volume' instance d05d0a5e-e6bc-4234-b354-9792304bc88b while it is in vm_state rescued {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:54:38.861220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c5b308d8-56f6-484f-8922-14d4869fb8f9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039985 May 23 10:54:38.861220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 199/393] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:54:38 2022] POST /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 10:54:38.865800 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-824d68d3-6b56-49e3-9ea2-ee8e6e457d0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:38.866408 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-824d68d3-6b56-49e3-9ea2-ee8e6e457d0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:38.872372 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-824d68d3-6b56-49e3-9ea2-ee8e6e457d0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:38.872817 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-824d68d3-6b56-49e3-9ea2-ee8e6e457d0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:38.873575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-824d68d3-6b56-49e3-9ea2-ee8e6e457d0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:38.874025 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-824d68d3-6b56-49e3-9ea2-ee8e6e457d0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:38.938288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-824d68d3-6b56-49e3-9ea2-ee8e6e457d0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b/action" status: 202 len: 0 microversion: 2.1 time: 0.076054 May 23 10:54:38.938905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 195/394] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 10:54:38 2022] POST /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 10:54:38.947002 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9b1cb8a9-fc27-454c-ad5d-23294916a449 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:38.948831 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9b1cb8a9-fc27-454c-ad5d-23294916a449 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:38.955009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9b1cb8a9-fc27-454c-ad5d-23294916a449 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:38.955538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9b1cb8a9-fc27-454c-ad5d-23294916a449 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:38.956326 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9b1cb8a9-fc27-454c-ad5d-23294916a449 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:38.956762 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9b1cb8a9-fc27-454c-ad5d-23294916a449 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:39.087658 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9b1cb8a9-fc27-454c-ad5d-23294916a449 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:39.095162 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9b1cb8a9-fc27-454c-ad5d-23294916a449 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1510 microversion: 2.1 time: 0.151882 May 23 10:54:39.095674 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 200/395] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:38 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:39.667593 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f8ef9084-2dbd-4f79-a500-26f58f96ec0d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:39.668241 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f8ef9084-2dbd-4f79-a500-26f58f96ec0d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:39.674409 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f8ef9084-2dbd-4f79-a500-26f58f96ec0d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:39.674858 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f8ef9084-2dbd-4f79-a500-26f58f96ec0d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:39.675624 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f8ef9084-2dbd-4f79-a500-26f58f96ec0d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:39.676061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f8ef9084-2dbd-4f79-a500-26f58f96ec0d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:39.800651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-f8ef9084-2dbd-4f79-a500-26f58f96ec0d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lazy-loading 'services' on Instance uuid 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:54:39.919701 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f8ef9084-2dbd-4f79-a500-26f58f96ec0d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/os-volume_attachments/02657450-370c-4639-9fe2-2277d4bc507f" status: 202 len: 0 microversion: 2.1 time: 0.257446 May 23 10:54:39.920302 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 196/396] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 10:54:39 2022] DELETE /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/os-volume_attachments/02657450-370c-4639-9fe2-2277d4bc507f => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:54:40.112310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f3fef5c3-258b-41ae-b8e3-e9f1b1454f31 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:40.112910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f3fef5c3-258b-41ae-b8e3-e9f1b1454f31 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:40.116068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=46 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:40.127162 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f3fef5c3-258b-41ae-b8e3-e9f1b1454f31 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:40.127606 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f3fef5c3-258b-41ae-b8e3-e9f1b1454f31 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:40.128375 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f3fef5c3-258b-41ae-b8e3-e9f1b1454f31 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:40.128808 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f3fef5c3-258b-41ae-b8e3-e9f1b1454f31 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:40.147208 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:40.261343 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f3fef5c3-258b-41ae-b8e3-e9f1b1454f31 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:40.268716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f3fef5c3-258b-41ae-b8e3-e9f1b1454f31 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1510 microversion: 2.1 time: 0.160346 May 23 10:54:40.269272 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 201/397] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:40 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:41.287335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e1213a19-769f-411a-adae-ba8bba0134fe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:41.288084 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e1213a19-769f-411a-adae-ba8bba0134fe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:41.294893 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e1213a19-769f-411a-adae-ba8bba0134fe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:41.295335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e1213a19-769f-411a-adae-ba8bba0134fe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:41.296090 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e1213a19-769f-411a-adae-ba8bba0134fe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:41.296511 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e1213a19-769f-411a-adae-ba8bba0134fe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:41.430122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e1213a19-769f-411a-adae-ba8bba0134fe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:41.437576 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e1213a19-769f-411a-adae-ba8bba0134fe tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1510 microversion: 2.1 time: 0.154905 May 23 10:54:41.438177 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 197/398] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:41 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:42.454206 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6abb967f-e4b0-4e0f-b9ae-4e1ad4972603 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:42.454822 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6abb967f-e4b0-4e0f-b9ae-4e1ad4972603 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:42.461219 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6abb967f-e4b0-4e0f-b9ae-4e1ad4972603 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:42.461664 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6abb967f-e4b0-4e0f-b9ae-4e1ad4972603 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:42.462448 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6abb967f-e4b0-4e0f-b9ae-4e1ad4972603 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:42.462882 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6abb967f-e4b0-4e0f-b9ae-4e1ad4972603 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:42.587842 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6abb967f-e4b0-4e0f-b9ae-4e1ad4972603 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:42.595198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6abb967f-e4b0-4e0f-b9ae-4e1ad4972603 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1516 microversion: 2.1 time: 0.144957 May 23 10:54:42.595756 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 202/399] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:42 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1516 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:43.918694 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9cf1bbc8-8082-421b-88ee-05a6cb9d2c69 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'create', calling method: .version_select at 0x7fe720213c10>, body: {"keypair": {"name": "tempest-keypair-1362548933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6ezo3CaNnrf+3ipOOz9K/Z64XUE4j6TsVeoKvhPxs5ps1MxRrTYTDAZJAZShGyQd/XrNVxdjO0K4ezbekw1Fhsuwz+3qXZJ64+pqbBGxDQUTauAgP8nm4tfubUouC2pg=="}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:43.932773 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-9cf1bbc8-8082-421b-88ee-05a6cb9d2c69 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Getting quotas for project 33781de828264846b90b5cbbbeee7fe5. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:54:43.936578 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-9cf1bbc8-8082-421b-88ee-05a6cb9d2c69 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Getting quotas for user 06f644c1c44d4dafacbd5bbdde323ff0 and project 33781de828264846b90b5cbbbeee7fe5. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:54:43.957925 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9cf1bbc8-8082-421b-88ee-05a6cb9d2c69 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043683 May 23 10:54:43.958553 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 198/400] 10.222.0.36 () {60 vars in 1158 bytes} [Mon May 23 10:54:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:54:44.195994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5fe6fc32-42a7-48c1-8c02-61d9fcadd69b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:44.202690 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5fe6fc32-42a7-48c1-8c02-61d9fcadd69b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:44.203166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5fe6fc32-42a7-48c1-8c02-61d9fcadd69b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:44.228986 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5fe6fc32-42a7-48c1-8c02-61d9fcadd69b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Going to try to stop instance {{(pid=129029) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 10:54:44.274301 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5fe6fc32-42a7-48c1-8c02-61d9fcadd69b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/action" status: 202 len: 0 microversion: 2.1 time: 0.082546 May 23 10:54:44.274933 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 203/401] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 10:54:44 2022] POST /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:54:44.283018 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d9290e3d-0ef9-4b74-877f-6ec4f0b27ef7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:44.283654 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d9290e3d-0ef9-4b74-877f-6ec4f0b27ef7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:44.290339 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d9290e3d-0ef9-4b74-877f-6ec4f0b27ef7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:44.290762 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d9290e3d-0ef9-4b74-877f-6ec4f0b27ef7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:44.291518 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d9290e3d-0ef9-4b74-877f-6ec4f0b27ef7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:44.291950 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d9290e3d-0ef9-4b74-877f-6ec4f0b27ef7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:44.427387 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d9290e3d-0ef9-4b74-877f-6ec4f0b27ef7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:44.435184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d9290e3d-0ef9-4b74-877f-6ec4f0b27ef7 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1677 microversion: 2.1 time: 0.156133 May 23 10:54:44.435828 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 199/402] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:44 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:45.253116 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1985982869", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "caad92d4-19b0-45f9-b915-72876566d29c"}], "security_groups": [{"name": "tempest-securitygroup--1255107077"}], "key_name": "tempest-keypair-1362548933", "user_data": "}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:45.354152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] validate_networks() for [('caad92d4-19b0-45f9-b915-72876566d29c', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:54:45.452554 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-86504a5f-7eeb-47c9-a006-a876edb2c62d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:45.453161 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-86504a5f-7eeb-47c9-a006-a876edb2c62d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:45.459629 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86504a5f-7eeb-47c9-a006-a876edb2c62d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:45.460076 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86504a5f-7eeb-47c9-a006-a876edb2c62d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:45.461330 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86504a5f-7eeb-47c9-a006-a876edb2c62d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:45.461767 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86504a5f-7eeb-47c9-a006-a876edb2c62d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:45.591158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-86504a5f-7eeb-47c9-a006-a876edb2c62d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:45.598736 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-86504a5f-7eeb-47c9-a006-a876edb2c62d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1677 microversion: 2.1 time: 0.150087 May 23 10:54:45.599310 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 200/403] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:45 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:45.718188 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:54:45.718637 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:54:45.719171 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:54:45.719585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:54:45.720000 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:54:45.729481 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:45.729930 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:45.730828 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:45.731270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:45.747842 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Getting quotas for project 33781de828264846b90b5cbbbeee7fe5. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:54:45.751798 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Getting quotas for user 06f644c1c44d4dafacbd5bbdde323ff0 and project 33781de828264846b90b5cbbbeee7fe5. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:54:45.763156 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:54:45.765502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:54:45.811745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ed83482f-44db-4042-88de-8b98121ee907 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.563656 May 23 10:54:45.812384 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 204/404] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:54:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:54:45.822389 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f6b0f2ab-eb83-468b-83bd-81e4c13e3ce2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:45.822994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f6b0f2ab-eb83-468b-83bd-81e4c13e3ce2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:45.874181 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f6b0f2ab-eb83-468b-83bd-81e4c13e3ce2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:45.882401 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f6b0f2ab-eb83-468b-83bd-81e4c13e3ce2 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1246 microversion: 2.1 time: 0.063946 May 23 10:54:45.883098 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 201/405] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:45 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1246 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:46.223037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-18942c38-5eed-4755-9b1b-3ca7346358e8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:46.223523 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-18942c38-5eed-4755-9b1b-3ca7346358e8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:46.231575 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-18942c38-5eed-4755-9b1b-3ca7346358e8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.232504 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-18942c38-5eed-4755-9b1b-3ca7346358e8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.233269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-18942c38-5eed-4755-9b1b-3ca7346358e8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.233820 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-18942c38-5eed-4755-9b1b-3ca7346358e8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.261212 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-18942c38-5eed-4755-9b1b-3ca7346358e8 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07/ips" status: 200 len: 148 microversion: 2.1 time: 0.042004 May 23 10:54:46.261935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 205/406] 10.222.0.36 () {58 vars in 1247 bytes} [Mon May 23 10:54:46 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:54:46.272405 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9af24d75-1653-4a96-a987-d605813e9e4b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e81aa104-d691-465f-8d99-90e7d630f035"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:46.274118 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9af24d75-1653-4a96-a987-d605813e9e4b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:46.280714 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9af24d75-1653-4a96-a987-d605813e9e4b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.281160 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9af24d75-1653-4a96-a987-d605813e9e4b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.281925 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9af24d75-1653-4a96-a987-d605813e9e4b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.282390 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9af24d75-1653-4a96-a987-d605813e9e4b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.378644 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-9af24d75-1653-4a96-a987-d605813e9e4b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Invalid volume: volume e81aa104-d691-465f-8d99-90e7d630f035 is already attached to instances: f3019f51-1a3a-4457-a89a-9ba5759f792d May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9af24d75-1653-4a96-a987-d605813e9e4b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: POST /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07/os-volume_attachments HTTP/1.1 May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 74 May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:54:46.380378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {"volumeAttachment": {"volumeId": "e81aa104-d691-465f-8d99-90e7d630f035"}} May 23 10:54:46.382428 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Invalid volume: volume e81aa104-d691-465f-8d99-90e7d630f035 is already attached to instances: f3019f51-1a3a-4457-a89a-9ba5759f792d May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'server_id': 'fc1671c4-e70e-4431-88d7-9ea12615aa07', 'body': {'volumeAttachment': {'volumeId': 'e81aa104-d691-465f-8d99-90e7d630f035'}}} May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e81aa104-d691-465f-8d99-90e7d630f035 is already attached to instances: f3019f51-1a3a-4457-a89a-9ba5759f792d May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:54:46.387564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e81aa104-d691-465f-8d99-90e7d630f035 is already attached to instances: f3019f51-1a3a-4457-a89a-9ba5759f792d May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:54:46.389158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:54:46.390616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:54:46.390616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:54:46.390616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:54:46.390616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e81aa104-d691-465f-8d99-90e7d630f035 is already attached to instances: f3019f51-1a3a-4457-a89a-9ba5759f792d May 23 10:54:46.390616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:54:46.390616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9af24d75-1653-4a96-a987-d605813e9e4b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 400 to user: Invalid volume: volume e81aa104-d691-465f-8d99-90e7d630f035 is already attached to instances: f3019f51-1a3a-4457-a89a-9ba5759f792d {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:54:46.390616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9af24d75-1653-4a96-a987-d605813e9e4b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113907 May 23 10:54:46.390616 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 202/407] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:54:46 2022] POST /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 10:54:46.392052 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-64d00c90-47bb-44a8-b287-b9bc8b5282db tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:46.392645 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-64d00c90-47bb-44a8-b287-b9bc8b5282db tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:46.399384 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-64d00c90-47bb-44a8-b287-b9bc8b5282db tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.399838 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-64d00c90-47bb-44a8-b287-b9bc8b5282db tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.400614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-64d00c90-47bb-44a8-b287-b9bc8b5282db tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.401048 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-64d00c90-47bb-44a8-b287-b9bc8b5282db tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.425797 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-64d00c90-47bb-44a8-b287-b9bc8b5282db tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:54:46.503241 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-64d00c90-47bb-44a8-b287-b9bc8b5282db tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 204 len: 0 microversion: 2.1 time: 0.114647 May 23 10:54:46.503904 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 206/408] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:54:46 2022] DELETE /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:54:46.512606 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f05fa623-24e5-4ef2-a860-daa441089330 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:46.513223 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f05fa623-24e5-4ef2-a860-daa441089330 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:46.520557 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f05fa623-24e5-4ef2-a860-daa441089330 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.521011 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f05fa623-24e5-4ef2-a860-daa441089330 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.521780 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f05fa623-24e5-4ef2-a860-daa441089330 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.522247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f05fa623-24e5-4ef2-a860-daa441089330 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.617846 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e47191b8-dc96-4089-a519-be526dd425f2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:46.618684 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e47191b8-dc96-4089-a519-be526dd425f2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:46.624673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e47191b8-dc96-4089-a519-be526dd425f2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.625214 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e47191b8-dc96-4089-a519-be526dd425f2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.626093 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e47191b8-dc96-4089-a519-be526dd425f2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.626606 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e47191b8-dc96-4089-a519-be526dd425f2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.652652 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f05fa623-24e5-4ef2-a860-daa441089330 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:46.660289 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f05fa623-24e5-4ef2-a860-daa441089330 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1679 microversion: 2.1 time: 0.151511 May 23 10:54:46.660873 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 203/409] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:46 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:46.758094 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e47191b8-dc96-4089-a519-be526dd425f2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:46.765520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e47191b8-dc96-4089-a519-be526dd425f2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1677 microversion: 2.1 time: 0.152516 May 23 10:54:46.766099 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 207/410] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:46 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:54:46.899027 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ba2871eb-af18-4a15-9d5c-e1427d7c499b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:46.899594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ba2871eb-af18-4a15-9d5c-e1427d7c499b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:46.905553 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ba2871eb-af18-4a15-9d5c-e1427d7c499b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.906019 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ba2871eb-af18-4a15-9d5c-e1427d7c499b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.906772 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ba2871eb-af18-4a15-9d5c-e1427d7c499b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:46.907203 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ba2871eb-af18-4a15-9d5c-e1427d7c499b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:46.969706 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ba2871eb-af18-4a15-9d5c-e1427d7c499b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:46.977574 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ba2871eb-af18-4a15-9d5c-e1427d7c499b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1298 microversion: 2.1 time: 0.082662 May 23 10:54:46.978157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 204/411] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:46 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:47.677680 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-24664431-3fcb-424b-85b9-75cb63e2d9ac tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:47.678346 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-24664431-3fcb-424b-85b9-75cb63e2d9ac tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:47.685395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-24664431-3fcb-424b-85b9-75cb63e2d9ac tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:47.685846 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-24664431-3fcb-424b-85b9-75cb63e2d9ac tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:47.686643 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-24664431-3fcb-424b-85b9-75cb63e2d9ac tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:47.687083 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-24664431-3fcb-424b-85b9-75cb63e2d9ac tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:47.783727 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-404d9946-95c0-4466-9730-7c06903e2ff9 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:47.784355 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-404d9946-95c0-4466-9730-7c06903e2ff9 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:47.790906 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-404d9946-95c0-4466-9730-7c06903e2ff9 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:47.791367 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-404d9946-95c0-4466-9730-7c06903e2ff9 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:47.792140 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-404d9946-95c0-4466-9730-7c06903e2ff9 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:47.792577 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-404d9946-95c0-4466-9730-7c06903e2ff9 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:47.796683 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:47.816053 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-24664431-3fcb-424b-85b9-75cb63e2d9ac tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:47.824325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-24664431-3fcb-424b-85b9-75cb63e2d9ac tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1679 microversion: 2.1 time: 0.150545 May 23 10:54:47.824902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 208/412] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:47 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:47.921931 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-404d9946-95c0-4466-9730-7c06903e2ff9 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:47.929917 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-404d9946-95c0-4466-9730-7c06903e2ff9 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1677 microversion: 2.1 time: 0.149547 May 23 10:54:47.930463 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 205/413] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:47 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:54:47.994887 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d1ee0b34-c83b-4817-a520-c203f1ef66d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:47.995489 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d1ee0b34-c83b-4817-a520-c203f1ef66d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:48.001393 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d1ee0b34-c83b-4817-a520-c203f1ef66d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:48.001833 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d1ee0b34-c83b-4817-a520-c203f1ef66d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:48.002620 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d1ee0b34-c83b-4817-a520-c203f1ef66d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:48.003056 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d1ee0b34-c83b-4817-a520-c203f1ef66d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:48.065086 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d1ee0b34-c83b-4817-a520-c203f1ef66d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:48.073483 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d1ee0b34-c83b-4817-a520-c203f1ef66d5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1298 microversion: 2.1 time: 0.083096 May 23 10:54:48.074124 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 209/414] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:47 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:48.841836 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b18436a0-8f86-480e-b165-7a81855c8b49 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:48.842607 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b18436a0-8f86-480e-b165-7a81855c8b49 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:48.849907 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b18436a0-8f86-480e-b165-7a81855c8b49 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:48.850462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b18436a0-8f86-480e-b165-7a81855c8b49 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:48.851364 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b18436a0-8f86-480e-b165-7a81855c8b49 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:48.851875 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b18436a0-8f86-480e-b165-7a81855c8b49 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:48.946779 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9a2ae336-3c98-4a47-8483-71f925d49a5b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:48.947484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9a2ae336-3c98-4a47-8483-71f925d49a5b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:48.954136 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9a2ae336-3c98-4a47-8483-71f925d49a5b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:48.954606 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9a2ae336-3c98-4a47-8483-71f925d49a5b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:48.955374 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9a2ae336-3c98-4a47-8483-71f925d49a5b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:48.955807 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9a2ae336-3c98-4a47-8483-71f925d49a5b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:49.094023 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9a2ae336-3c98-4a47-8483-71f925d49a5b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:49.101616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9a2ae336-3c98-4a47-8483-71f925d49a5b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1677 microversion: 2.1 time: 0.159168 May 23 10:54:49.102317 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 210/415] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:48 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:54:49.106542 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-751ca162-3773-46b0-a042-aa35bb9adf06 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:49.107145 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-751ca162-3773-46b0-a042-aa35bb9adf06 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:49.112828 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-751ca162-3773-46b0-a042-aa35bb9adf06 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:49.113284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-751ca162-3773-46b0-a042-aa35bb9adf06 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:49.114079 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-751ca162-3773-46b0-a042-aa35bb9adf06 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:49.114525 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-751ca162-3773-46b0-a042-aa35bb9adf06 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:49.131568 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b18436a0-8f86-480e-b165-7a81855c8b49 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:49.140142 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b18436a0-8f86-480e-b165-7a81855c8b49 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1679 microversion: 2.1 time: 0.302399 May 23 10:54:49.140916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 206/416] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:48 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1679 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:49.181245 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-751ca162-3773-46b0-a042-aa35bb9adf06 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:49.188988 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-751ca162-3773-46b0-a042-aa35bb9adf06 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1304 microversion: 2.1 time: 0.085865 May 23 10:54:49.189573 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 211/417] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:49 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:50.118599 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-fe3a28b1-fb1d-4013-89f4-49fe940ecb94 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:50.119202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-fe3a28b1-fb1d-4013-89f4-49fe940ecb94 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:50.126255 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fe3a28b1-fb1d-4013-89f4-49fe940ecb94 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:50.126707 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fe3a28b1-fb1d-4013-89f4-49fe940ecb94 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:50.127476 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fe3a28b1-fb1d-4013-89f4-49fe940ecb94 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:50.127934 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fe3a28b1-fb1d-4013-89f4-49fe940ecb94 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:50.158735 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-82f5e47c-546c-4e0d-93f8-493f78b994a1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:50.159420 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-82f5e47c-546c-4e0d-93f8-493f78b994a1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:50.166349 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-82f5e47c-546c-4e0d-93f8-493f78b994a1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:50.166793 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-82f5e47c-546c-4e0d-93f8-493f78b994a1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:50.167558 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-82f5e47c-546c-4e0d-93f8-493f78b994a1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:50.167988 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-82f5e47c-546c-4e0d-93f8-493f78b994a1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:50.245435 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-82f5e47c-546c-4e0d-93f8-493f78b994a1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:50.253160 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-82f5e47c-546c-4e0d-93f8-493f78b994a1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 200 len: 1611 microversion: 2.1 time: 0.098085 May 23 10:54:50.259132 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 212/418] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:50 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 1611 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:54:50.264782 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-739f2b93-f62a-42fc-aaae-53de72ae3db8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:50.265384 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-739f2b93-f62a-42fc-aaae-53de72ae3db8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:50.271800 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-739f2b93-f62a-42fc-aaae-53de72ae3db8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:50.272253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-739f2b93-f62a-42fc-aaae-53de72ae3db8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:50.273070 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-739f2b93-f62a-42fc-aaae-53de72ae3db8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:50.274074 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-739f2b93-f62a-42fc-aaae-53de72ae3db8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:50.335031 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-739f2b93-f62a-42fc-aaae-53de72ae3db8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:50.345724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-739f2b93-f62a-42fc-aaae-53de72ae3db8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1304 microversion: 2.1 time: 0.090531 May 23 10:54:50.346524 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 213/419] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:50 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:50.455344 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-fe3a28b1-fb1d-4013-89f4-49fe940ecb94 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:50.463603 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-fe3a28b1-fb1d-4013-89f4-49fe940ecb94 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1677 microversion: 2.1 time: 0.348281 May 23 10:54:50.474051 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 207/420] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:50 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1677 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:50.558415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-1b2ae6d0-dcdb-405e-b20b-7f77314b6b8d req-d1c6562c-1a5d-4f43-9c57-b4e7272976b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1671c4-e70e-4431-88d7-9ea12615aa07", "name": "network-vif-deleted", "tag": "09d7f930-a93b-4df0-9ea7-29ea518e1743"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:50.567020 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-1b2ae6d0-dcdb-405e-b20b-7f77314b6b8d req-d1c6562c-1a5d-4f43-9c57-b4e7272976b0 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:50.567464 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-1b2ae6d0-dcdb-405e-b20b-7f77314b6b8d req-d1c6562c-1a5d-4f43-9c57-b4e7272976b0 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:50.580866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-1b2ae6d0-dcdb-405e-b20b-7f77314b6b8d req-d1c6562c-1a5d-4f43-9c57-b4e7272976b0 service nova] Creating event network-vif-deleted:09d7f930-a93b-4df0-9ea7-29ea518e1743 for instance fc1671c4-e70e-4431-88d7-9ea12615aa07 on hv-cinder-83699 May 23 10:54:50.588070 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-1b2ae6d0-dcdb-405e-b20b-7f77314b6b8d req-d1c6562c-1a5d-4f43-9c57-b4e7272976b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033774 May 23 10:54:50.589403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 214/421] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:54:51.272049 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0e5b19dc-c109-4dbf-90ae-0a7a606d072f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:51.273290 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0e5b19dc-c109-4dbf-90ae-0a7a606d072f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:51.279668 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:51.281828 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0e5b19dc-c109-4dbf-90ae-0a7a606d072f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:51.282515 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0e5b19dc-c109-4dbf-90ae-0a7a606d072f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:51.285621 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0e5b19dc-c109-4dbf-90ae-0a7a606d072f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:51.286375 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0e5b19dc-c109-4dbf-90ae-0a7a606d072f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:51.315599 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-0e5b19dc-c109-4dbf-90ae-0a7a606d072f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0e5b19dc-c109-4dbf-90ae-0a7a606d072f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 HTTP/1.1 May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:54:51.317346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:54:51.318731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'fc1671c4-e70e-4431-88d7-9ea12615aa07'} May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:54:51.319450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:54:51.320594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:54:51.323259 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0e5b19dc-c109-4dbf-90ae-0a7a606d072f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:54:51.324751 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0e5b19dc-c109-4dbf-90ae-0a7a606d072f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 404 len: 111 microversion: 2.1 time: 0.057353 May 23 10:54:51.328981 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 208/422] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:51 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:54:51.338275 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0d3ba93b-61d3-41d3-a386-481e610f292d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '.version_select at 0x7fe72018dee0>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:51.341551 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0d3ba93b-61d3-41d3-a386-481e610f292d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [265b7f4f-9175-4125-948f-e877bfc16411] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 10:54:51.362865 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0daed0c8-a183-4516-9566-4c280f183729 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:51.363989 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0daed0c8-a183-4516-9566-4c280f183729 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:51.375843 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0daed0c8-a183-4516-9566-4c280f183729 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:51.376601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0daed0c8-a183-4516-9566-4c280f183729 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:51.377601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0daed0c8-a183-4516-9566-4c280f183729 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:51.378247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0daed0c8-a183-4516-9566-4c280f183729 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:51.673515 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0daed0c8-a183-4516-9566-4c280f183729 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:51.682063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0daed0c8-a183-4516-9566-4c280f183729 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1372 microversion: 2.1 time: 0.322968 May 23 10:54:51.683044 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 209/423] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:51 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1372 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:54:51.687611 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-03e79b59-5e90-464b-abcc-7336c270b283 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:51.688471 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-03e79b59-5e90-464b-abcc-7336c270b283 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:51.695681 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-03e79b59-5e90-464b-abcc-7336c270b283 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:51.696427 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-03e79b59-5e90-464b-abcc-7336c270b283 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:51.697699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-03e79b59-5e90-464b-abcc-7336c270b283 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:51.698422 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-03e79b59-5e90-464b-abcc-7336c270b283 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:51.985327 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-03e79b59-5e90-464b-abcc-7336c270b283 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:51.995442 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-03e79b59-5e90-464b-abcc-7336c270b283 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1677 microversion: 2.1 time: 0.311214 May 23 10:54:52.005755 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 210/424] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:51 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1677 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:52.348682 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO oslo.messaging._drivers.impl_rabbit [None req-0d3ba93b-61d3-41d3-a386-481e610f292d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [265b7f4f-9175-4125-948f-e877bfc16411] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 42130. May 23 10:54:52.367724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-0d3ba93b-61d3-41d3-a386-481e610f292d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-301637765" status: 202 len: 0 microversion: 2.1 time: 1.037399 May 23 10:54:52.368314 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 215/425] 10.222.0.36 () {58 vars in 1217 bytes} [Mon May 23 10:54:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-301637765 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:54:52.610601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-c33003ad-bc86-4935-a4ae-c0963bef0222 req-d07eacb2-66da-4570-b9e7-6a382acfa80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67badd04-43b7-41f4-88fc-c7435ac2f158", "tag": "9da49a79-8d41-4702-8f35-b66bc046212c"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:52.620482 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-c33003ad-bc86-4935-a4ae-c0963bef0222 req-d07eacb2-66da-4570-b9e7-6a382acfa80b service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:52.620924 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-c33003ad-bc86-4935-a4ae-c0963bef0222 req-d07eacb2-66da-4570-b9e7-6a382acfa80b service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:52.632089 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-c33003ad-bc86-4935-a4ae-c0963bef0222 req-d07eacb2-66da-4570-b9e7-6a382acfa80b service nova] Creating event network-changed:9da49a79-8d41-4702-8f35-b66bc046212c for instance 67badd04-43b7-41f4-88fc-c7435ac2f158 on hv-cinder-83699 May 23 10:54:52.637297 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-c33003ad-bc86-4935-a4ae-c0963bef0222 req-d07eacb2-66da-4570-b9e7-6a382acfa80b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030172 May 23 10:54:52.637889 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 211/426] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:54:52.699059 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cb531bd7-2057-41fe-93d5-5a05c01be5b9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:52.699814 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-cb531bd7-2057-41fe-93d5-5a05c01be5b9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:52.715853 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cb531bd7-2057-41fe-93d5-5a05c01be5b9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:52.716321 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cb531bd7-2057-41fe-93d5-5a05c01be5b9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:52.717116 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cb531bd7-2057-41fe-93d5-5a05c01be5b9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:52.717559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cb531bd7-2057-41fe-93d5-5a05c01be5b9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:52.861509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-cb531bd7-2057-41fe-93d5-5a05c01be5b9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:52.870776 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-cb531bd7-2057-41fe-93d5-5a05c01be5b9 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1372 microversion: 2.1 time: 0.175664 May 23 10:54:52.880163 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 216/427] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:52 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:53.013515 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1f1cd869-a8c2-4bd6-a8bb-09c40f90fe68 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:53.014512 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1f1cd869-a8c2-4bd6-a8bb-09c40f90fe68 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:53.021854 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1f1cd869-a8c2-4bd6-a8bb-09c40f90fe68 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:53.022408 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1f1cd869-a8c2-4bd6-a8bb-09c40f90fe68 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:53.023833 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1f1cd869-a8c2-4bd6-a8bb-09c40f90fe68 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:53.024454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1f1cd869-a8c2-4bd6-a8bb-09c40f90fe68 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:53.055487 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bfd9539c-36b7-4489-8248-20a5b6fb17d3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:53.055939 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bfd9539c-36b7-4489-8248-20a5b6fb17d3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:53.071589 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfd9539c-36b7-4489-8248-20a5b6fb17d3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:53.072035 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfd9539c-36b7-4489-8248-20a5b6fb17d3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:53.072803 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfd9539c-36b7-4489-8248-20a5b6fb17d3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:53.073235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfd9539c-36b7-4489-8248-20a5b6fb17d3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:53.159052 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1f1cd869-a8c2-4bd6-a8bb-09c40f90fe68 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:53.173176 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1f1cd869-a8c2-4bd6-a8bb-09c40f90fe68 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1677 microversion: 2.1 time: 0.163233 May 23 10:54:53.174237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 212/428] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:53 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:53.217330 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-bfd9539c-36b7-4489-8248-20a5b6fb17d3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lazy-loading 'services' on Instance uuid f3019f51-1a3a-4457-a89a-9ba5759f792d {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:54:53.255359 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:53.341084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bfd9539c-36b7-4489-8248-20a5b6fb17d3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/os-volume_attachments/e81aa104-d691-465f-8d99-90e7d630f035" status: 202 len: 0 microversion: 2.1 time: 0.288807 May 23 10:54:53.341628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 217/429] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 10:54:53 2022] DELETE /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/os-volume_attachments/e81aa104-d691-465f-8d99-90e7d630f035 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 10:54:53.350528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b43ef858-7fa9-4f33-b14a-d100c4d20c5a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:53.351735 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b43ef858-7fa9-4f33-b14a-d100c4d20c5a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:53.358063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b43ef858-7fa9-4f33-b14a-d100c4d20c5a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:53.358511 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b43ef858-7fa9-4f33-b14a-d100c4d20c5a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:53.359447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b43ef858-7fa9-4f33-b14a-d100c4d20c5a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:53.360066 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b43ef858-7fa9-4f33-b14a-d100c4d20c5a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:53.394986 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b43ef858-7fa9-4f33-b14a-d100c4d20c5a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048801 May 23 10:54:53.396559 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 213/430] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:54:53 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:54:53.889002 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b3e0c271-7400-4936-b9c2-0d6b62f8ea3b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:53.889703 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b3e0c271-7400-4936-b9c2-0d6b62f8ea3b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:53.896314 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b3e0c271-7400-4936-b9c2-0d6b62f8ea3b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:53.896769 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b3e0c271-7400-4936-b9c2-0d6b62f8ea3b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:53.897543 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b3e0c271-7400-4936-b9c2-0d6b62f8ea3b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:53.898008 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b3e0c271-7400-4936-b9c2-0d6b62f8ea3b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:54.029705 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b3e0c271-7400-4936-b9c2-0d6b62f8ea3b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:54.037153 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b3e0c271-7400-4936-b9c2-0d6b62f8ea3b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1372 microversion: 2.1 time: 0.152450 May 23 10:54:54.037717 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 218/431] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:53 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:54.190575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-734aa4a1-bc5f-4f52-ae44-0595c746aded tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:54.191187 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-734aa4a1-bc5f-4f52-ae44-0595c746aded tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:54.198169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-734aa4a1-bc5f-4f52-ae44-0595c746aded tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:54.198620 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-734aa4a1-bc5f-4f52-ae44-0595c746aded tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:54.199382 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-734aa4a1-bc5f-4f52-ae44-0595c746aded tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:54.199821 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-734aa4a1-bc5f-4f52-ae44-0595c746aded tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:54.326698 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-734aa4a1-bc5f-4f52-ae44-0595c746aded tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:54.334872 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-734aa4a1-bc5f-4f52-ae44-0595c746aded tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1677 microversion: 2.1 time: 0.147686 May 23 10:54:54.335962 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 214/432] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:54 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:54.408467 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-47953f0b-a69b-4aae-9293-57025bdde77c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:54.409398 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-47953f0b-a69b-4aae-9293-57025bdde77c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:54.416480 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47953f0b-a69b-4aae-9293-57025bdde77c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:54.416928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47953f0b-a69b-4aae-9293-57025bdde77c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:54.417688 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47953f0b-a69b-4aae-9293-57025bdde77c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:54.418323 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47953f0b-a69b-4aae-9293-57025bdde77c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:54.445530 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-47953f0b-a69b-4aae-9293-57025bdde77c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041093 May 23 10:54:54.446096 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 219/433] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:54:54 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 10:54:54.501869 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8d2b9dca-0eb4-4ece-b13e-53b7d4f6090d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:54.502416 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8d2b9dca-0eb4-4ece-b13e-53b7d4f6090d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:54.508689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8d2b9dca-0eb4-4ece-b13e-53b7d4f6090d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:54.509140 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8d2b9dca-0eb4-4ece-b13e-53b7d4f6090d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:54.509936 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8d2b9dca-0eb4-4ece-b13e-53b7d4f6090d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:54.510399 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8d2b9dca-0eb4-4ece-b13e-53b7d4f6090d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:54.535564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8d2b9dca-0eb4-4ece-b13e-53b7d4f6090d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Going to try to terminate instance {{(pid=129030) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:54:54.616050 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8d2b9dca-0eb4-4ece-b13e-53b7d4f6090d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 204 len: 0 microversion: 2.1 time: 0.117649 May 23 10:54:54.616556 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 215/434] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:54:54 2022] DELETE /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:54:54.625323 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e25f036e-44ed-430c-8b49-dbe91b9a1ed6 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:54.625929 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e25f036e-44ed-430c-8b49-dbe91b9a1ed6 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:54.631890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e25f036e-44ed-430c-8b49-dbe91b9a1ed6 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:54.632966 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e25f036e-44ed-430c-8b49-dbe91b9a1ed6 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:54.633756 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e25f036e-44ed-430c-8b49-dbe91b9a1ed6 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:54.634210 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e25f036e-44ed-430c-8b49-dbe91b9a1ed6 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:54.763038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e25f036e-44ed-430c-8b49-dbe91b9a1ed6 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:54.770702 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e25f036e-44ed-430c-8b49-dbe91b9a1ed6 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1683 microversion: 2.1 time: 0.149006 May 23 10:54:54.771277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 220/435] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:54 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:55.054345 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e93569a8-a777-4be3-b966-f17f85b5360a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:55.055068 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e93569a8-a777-4be3-b966-f17f85b5360a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:55.061905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e93569a8-a777-4be3-b966-f17f85b5360a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:55.062495 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e93569a8-a777-4be3-b966-f17f85b5360a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:55.063614 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e93569a8-a777-4be3-b966-f17f85b5360a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:55.064235 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e93569a8-a777-4be3-b966-f17f85b5360a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:55.196751 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e93569a8-a777-4be3-b966-f17f85b5360a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:55.204666 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e93569a8-a777-4be3-b966-f17f85b5360a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1372 microversion: 2.1 time: 0.154649 May 23 10:54:55.205227 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 216/436] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:55 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:55.351828 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6aa5783f-fcf8-44a3-a7d5-0644a6c9eb9e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:55.352360 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6aa5783f-fcf8-44a3-a7d5-0644a6c9eb9e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:55.358370 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6aa5783f-fcf8-44a3-a7d5-0644a6c9eb9e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:55.358814 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6aa5783f-fcf8-44a3-a7d5-0644a6c9eb9e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:55.359567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6aa5783f-fcf8-44a3-a7d5-0644a6c9eb9e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:55.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6aa5783f-fcf8-44a3-a7d5-0644a6c9eb9e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:55.487605 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6aa5783f-fcf8-44a3-a7d5-0644a6c9eb9e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:55.495667 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6aa5783f-fcf8-44a3-a7d5-0644a6c9eb9e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1654 microversion: 2.1 time: 0.147653 May 23 10:54:55.496234 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 221/437] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:55 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:55.511889 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-53de9624-a0ca-475d-847a-98b0176b276c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:55.517938 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-53de9624-a0ca-475d-847a-98b0176b276c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:55.518416 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-53de9624-a0ca-475d-847a-98b0176b276c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:55.578679 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-53de9624-a0ca-475d-847a-98b0176b276c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Going to try to start instance {{(pid=129030) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 10:54:55.620265 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-53de9624-a0ca-475d-847a-98b0176b276c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/action" status: 202 len: 0 microversion: 2.1 time: 0.112024 May 23 10:54:55.620846 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 217/438] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 10:54:55 2022] POST /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:54:55.628784 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f9ea46b1-5065-4539-ac48-f85d3586b205 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:55.629393 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f9ea46b1-5065-4539-ac48-f85d3586b205 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:55.635376 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f9ea46b1-5065-4539-ac48-f85d3586b205 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:55.635831 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f9ea46b1-5065-4539-ac48-f85d3586b205 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:55.636591 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f9ea46b1-5065-4539-ac48-f85d3586b205 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:55.637028 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f9ea46b1-5065-4539-ac48-f85d3586b205 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:55.737380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:55.758135 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=6 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:55.762128 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f9ea46b1-5065-4539-ac48-f85d3586b205 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:55.769797 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f9ea46b1-5065-4539-ac48-f85d3586b205 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1663 microversion: 2.1 time: 0.144842 May 23 10:54:55.770660 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 222/439] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:55 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1663 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:55.788138 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b0508b9a-9c53-4830-981d-1399ce3f322b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:55.789381 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b0508b9a-9c53-4830-981d-1399ce3f322b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:55.795605 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b0508b9a-9c53-4830-981d-1399ce3f322b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:55.796055 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b0508b9a-9c53-4830-981d-1399ce3f322b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:55.796820 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b0508b9a-9c53-4830-981d-1399ce3f322b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:55.797257 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b0508b9a-9c53-4830-981d-1399ce3f322b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:55.882855 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=6 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:55.929833 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b0508b9a-9c53-4830-981d-1399ce3f322b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:55.937426 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b0508b9a-9c53-4830-981d-1399ce3f322b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1683 microversion: 2.1 time: 0.153580 May 23 10:54:55.938254 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 218/440] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:55 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:56.220788 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-393f5190-1777-4cd5-8453-94450180060f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:56.221394 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-393f5190-1777-4cd5-8453-94450180060f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:56.228074 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-393f5190-1777-4cd5-8453-94450180060f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:56.228520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-393f5190-1777-4cd5-8453-94450180060f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:56.229280 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-393f5190-1777-4cd5-8453-94450180060f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:56.229716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-393f5190-1777-4cd5-8453-94450180060f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:56.357471 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-393f5190-1777-4cd5-8453-94450180060f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:56.366987 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-393f5190-1777-4cd5-8453-94450180060f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1372 microversion: 2.1 time: 0.149955 May 23 10:54:56.370916 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 223/441] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:56 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:56.787168 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d8e33c86-696c-432c-ae82-7f9541cecbee tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:56.787809 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d8e33c86-696c-432c-ae82-7f9541cecbee tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:56.794661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d8e33c86-696c-432c-ae82-7f9541cecbee tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:56.795110 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d8e33c86-696c-432c-ae82-7f9541cecbee tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:56.795884 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d8e33c86-696c-432c-ae82-7f9541cecbee tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:56.796318 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d8e33c86-696c-432c-ae82-7f9541cecbee tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:56.954999 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-260e1eb6-15a1-4e75-b802-1c734dcd6957 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:56.955825 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-260e1eb6-15a1-4e75-b802-1c734dcd6957 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:56.962958 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-260e1eb6-15a1-4e75-b802-1c734dcd6957 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:56.963401 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-260e1eb6-15a1-4e75-b802-1c734dcd6957 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:56.964168 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-260e1eb6-15a1-4e75-b802-1c734dcd6957 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:56.964598 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-260e1eb6-15a1-4e75-b802-1c734dcd6957 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:57.095280 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-260e1eb6-15a1-4e75-b802-1c734dcd6957 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:57.102822 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-260e1eb6-15a1-4e75-b802-1c734dcd6957 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1683 microversion: 2.1 time: 0.151633 May 23 10:54:57.103403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 224/442] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:56 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:54:57.114776 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d8e33c86-696c-432c-ae82-7f9541cecbee tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:57.122193 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d8e33c86-696c-432c-ae82-7f9541cecbee tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1663 microversion: 2.1 time: 0.338806 May 23 10:54:57.122761 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 219/443] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:56 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1663 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:57.384238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b7568d2d-41f1-41cb-8707-9e7d387d12f5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:57.384986 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b7568d2d-41f1-41cb-8707-9e7d387d12f5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:57.391154 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7568d2d-41f1-41cb-8707-9e7d387d12f5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:57.391611 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7568d2d-41f1-41cb-8707-9e7d387d12f5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:57.392395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7568d2d-41f1-41cb-8707-9e7d387d12f5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:57.392873 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7568d2d-41f1-41cb-8707-9e7d387d12f5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:57.530192 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b7568d2d-41f1-41cb-8707-9e7d387d12f5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:57.538396 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b7568d2d-41f1-41cb-8707-9e7d387d12f5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1372 microversion: 2.1 time: 0.158387 May 23 10:54:57.539674 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 225/444] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:57 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:58.072995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-78b584bd-34b6-46ce-85ce-cc96fde45191 req-1ee1570e-69d2-4d46-9e47-a5df27768e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3019f51-1a3a-4457-a89a-9ba5759f792d", "name": "network-vif-deleted", "tag": "0c4ac25b-ce3b-4b08-a309-9ebaccb55384"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:58.090367 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-78b584bd-34b6-46ce-85ce-cc96fde45191 req-1ee1570e-69d2-4d46-9e47-a5df27768e4b service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:58.090839 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-78b584bd-34b6-46ce-85ce-cc96fde45191 req-1ee1570e-69d2-4d46-9e47-a5df27768e4b service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:58.096022 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-8c0afa9e-52e4-47b3-b973-8491d3903dc3 req-9d65afb1-9dfe-448e-8049-f78506aab771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67badd04-43b7-41f4-88fc-c7435ac2f158", "name": "network-vif-plugged", "status": "completed", "tag": "9da49a79-8d41-4702-8f35-b66bc046212c"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:54:58.108486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-8c0afa9e-52e4-47b3-b973-8491d3903dc3 req-9d65afb1-9dfe-448e-8049-f78506aab771 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:58.109084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-8c0afa9e-52e4-47b3-b973-8491d3903dc3 req-9d65afb1-9dfe-448e-8049-f78506aab771 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:58.126328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-78b584bd-34b6-46ce-85ce-cc96fde45191 req-1ee1570e-69d2-4d46-9e47-a5df27768e4b service nova] Creating event network-vif-deleted:0c4ac25b-ce3b-4b08-a309-9ebaccb55384 for instance f3019f51-1a3a-4457-a89a-9ba5759f792d on hv-cinder-83699 May 23 10:54:58.136468 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-8c0afa9e-52e4-47b3-b973-8491d3903dc3 req-9d65afb1-9dfe-448e-8049-f78506aab771 service nova] Creating event network-vif-plugged:9da49a79-8d41-4702-8f35-b66bc046212c for instance 67badd04-43b7-41f4-88fc-c7435ac2f158 on hv-cinder-83699 May 23 10:54:58.141454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-8c0afa9e-52e4-47b3-b973-8491d3903dc3 req-9d65afb1-9dfe-448e-8049-f78506aab771 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048905 May 23 10:54:58.142184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 226/445] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:54:58.143713 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-78b584bd-34b6-46ce-85ce-cc96fde45191 req-1ee1570e-69d2-4d46-9e47-a5df27768e4b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074846 May 23 10:54:58.145600 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 220/446] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:54:58.154627 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a9e40a05-f42a-497e-a734-678dde0b84ec tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:58.155447 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a9e40a05-f42a-497e-a734-678dde0b84ec tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:58.158893 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-66cbce97-035b-426a-b46c-2e62ba9d7808 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:58.159714 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-66cbce97-035b-426a-b46c-2e62ba9d7808 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:58.169279 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9e40a05-f42a-497e-a734-678dde0b84ec tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:58.169747 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9e40a05-f42a-497e-a734-678dde0b84ec tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:58.170594 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9e40a05-f42a-497e-a734-678dde0b84ec tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:58.171039 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a9e40a05-f42a-497e-a734-678dde0b84ec tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:58.173676 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-66cbce97-035b-426a-b46c-2e62ba9d7808 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:58.182686 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-66cbce97-035b-426a-b46c-2e62ba9d7808 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:58.183746 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-66cbce97-035b-426a-b46c-2e62ba9d7808 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:58.184285 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-66cbce97-035b-426a-b46c-2e62ba9d7808 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:58.189371 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:54:58.266775 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a9e40a05-f42a-497e-a734-678dde0b84ec tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:58.276814 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a9e40a05-f42a-497e-a734-678dde0b84ec tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1327 microversion: 2.1 time: 0.133441 May 23 10:54:58.277328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 227/447] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:58 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:58.381530 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-66cbce97-035b-426a-b46c-2e62ba9d7808 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:58.389331 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-66cbce97-035b-426a-b46c-2e62ba9d7808 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1663 microversion: 2.1 time: 0.241167 May 23 10:54:58.389881 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 221/448] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:58 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1663 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:58.555807 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e5398724-3981-4554-ad0a-a37d08ee69ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:58.556413 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e5398724-3981-4554-ad0a-a37d08ee69ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:58.562515 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e5398724-3981-4554-ad0a-a37d08ee69ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:58.562963 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e5398724-3981-4554-ad0a-a37d08ee69ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:58.563731 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e5398724-3981-4554-ad0a-a37d08ee69ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:58.564190 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e5398724-3981-4554-ad0a-a37d08ee69ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:58.695365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e5398724-3981-4554-ad0a-a37d08ee69ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:58.702926 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e5398724-3981-4554-ad0a-a37d08ee69ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1372 microversion: 2.1 time: 0.150933 May 23 10:54:58.703497 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 228/449] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:58 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:59.293549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:59.294303 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:59.301208 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:59.301740 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:59.302688 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:59.303201 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:59.337656 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:59.338236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:59.338783 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lazy-loading 'fault' on Instance uuid f3019f51-1a3a-4457-a89a-9ba5759f792d {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:54:59.394337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:59.403832 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9b4ab749-f79d-4910-bfc3-69a4b8a4599c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 200 len: 1332 microversion: 2.1 time: 0.114049 May 23 10:54:59.404416 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 222/450] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:59 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:59.406969 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d3614666-811d-45cb-8951-0d185f3b9dd2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:59.407582 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d3614666-811d-45cb-8951-0d185f3b9dd2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:59.414693 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d3614666-811d-45cb-8951-0d185f3b9dd2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:59.415233 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d3614666-811d-45cb-8951-0d185f3b9dd2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:59.416084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d3614666-811d-45cb-8951-0d185f3b9dd2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:59.416585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d3614666-811d-45cb-8951-0d185f3b9dd2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:59.541663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d3614666-811d-45cb-8951-0d185f3b9dd2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:59.549038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d3614666-811d-45cb-8951-0d185f3b9dd2 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1667 microversion: 2.1 time: 0.146100 May 23 10:54:59.549603 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 229/451] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:59 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1667 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:54:59.719015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d4844e56-4f83-4a3a-87cb-619fa7711eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:54:59.719627 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d4844e56-4f83-4a3a-87cb-619fa7711eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:54:59.725673 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d4844e56-4f83-4a3a-87cb-619fa7711eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:59.726161 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d4844e56-4f83-4a3a-87cb-619fa7711eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:59.726928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d4844e56-4f83-4a3a-87cb-619fa7711eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:54:59.727370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d4844e56-4f83-4a3a-87cb-619fa7711eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:54:59.861905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d4844e56-4f83-4a3a-87cb-619fa7711eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:54:59.869857 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d4844e56-4f83-4a3a-87cb-619fa7711eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1372 microversion: 2.1 time: 0.154754 May 23 10:54:59.870454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 223/452] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:54:59 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:00.420630 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-439a9e02-2815-4c91-af80-8f7fef5ac8f9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:00.421175 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-439a9e02-2815-4c91-af80-8f7fef5ac8f9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:00.427782 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-439a9e02-2815-4c91-af80-8f7fef5ac8f9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:00.428236 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-439a9e02-2815-4c91-af80-8f7fef5ac8f9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:00.429002 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-439a9e02-2815-4c91-af80-8f7fef5ac8f9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:00.429443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-439a9e02-2815-4c91-af80-8f7fef5ac8f9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:00.442486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-439a9e02-2815-4c91-af80-8f7fef5ac8f9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-439a9e02-2815-4c91-af80-8f7fef5ac8f9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d HTTP/1.1 May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:55:00.444084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:55:00.445559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'f3019f51-1a3a-4457-a89a-9ba5759f792d'} May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:55:00.446369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:55:00.447459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:00.448456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-439a9e02-2815-4c91-af80-8f7fef5ac8f9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:55:00.448456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-439a9e02-2815-4c91-af80-8f7fef5ac8f9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 404 len: 111 microversion: 2.1 time: 0.028723 May 23 10:55:00.448456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 230/453] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:00 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:55:00.454031 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3b22c018-e00a-422e-a174-431366dd5ab7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '.version_select at 0x7fe720213ca0>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:00.472636 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3b22c018-e00a-422e-a174-431366dd5ab7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924477262" status: 202 len: 0 microversion: 2.1 time: 0.022355 May 23 10:55:00.473186 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 224/454] 10.222.0.36 () {58 vars in 1220 bytes} [Mon May 23 10:55:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924477262 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:55:00.887067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9135484d-1dcd-4a33-aae4-62a73a996a95 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:00.887695 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9135484d-1dcd-4a33-aae4-62a73a996a95 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:00.893664 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9135484d-1dcd-4a33-aae4-62a73a996a95 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:00.894156 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9135484d-1dcd-4a33-aae4-62a73a996a95 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:00.894933 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9135484d-1dcd-4a33-aae4-62a73a996a95 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:00.895638 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9135484d-1dcd-4a33-aae4-62a73a996a95 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:01.032650 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9135484d-1dcd-4a33-aae4-62a73a996a95 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:01.040253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9135484d-1dcd-4a33-aae4-62a73a996a95 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1372 microversion: 2.1 time: 0.156997 May 23 10:55:01.040834 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 231/455] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:00 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:01.068857 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8d3bc0cc-55a4-4bde-93a5-435f7f5bf1e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: .version_select at 0x7fe720089d30>, body: {"keypair": {"name": "tempest-keypair-1077688309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIVi1KZWCPaT99g78TwgdxuItxtejm6rLB9MPauqUlKsxIW7vkgNREHcwy7blfBElw0keh6sQ9ddGJSeBIRjkj7rTMIG4wcI+XReJbOszE5Zhu8cMQZVjMutFEvZjGoNA=="}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:01.083822 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-8d3bc0cc-55a4-4bde-93a5-435f7f5bf1e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:55:01.088658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-8d3bc0cc-55a4-4bde-93a5-435f7f5bf1e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for user 8e98c8ceac6b47079423b45685c5ba3e and project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:55:01.112405 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8d3bc0cc-55a4-4bde-93a5-435f7f5bf1e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047375 May 23 10:55:01.113243 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 225/456] 10.222.0.36 () {60 vars in 1158 bytes} [Mon May 23 10:55:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:02.057183 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-03267f4b-d9f1-43ff-8d4a-a4a1f7a1cfd5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:02.057930 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-03267f4b-d9f1-43ff-8d4a-a4a1f7a1cfd5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:02.064643 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-03267f4b-d9f1-43ff-8d4a-a4a1f7a1cfd5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:02.065110 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-03267f4b-d9f1-43ff-8d4a-a4a1f7a1cfd5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:02.065993 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-03267f4b-d9f1-43ff-8d4a-a4a1f7a1cfd5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:02.066522 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-03267f4b-d9f1-43ff-8d4a-a4a1f7a1cfd5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:02.270584 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-03267f4b-d9f1-43ff-8d4a-a4a1f7a1cfd5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:02.278947 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-03267f4b-d9f1-43ff-8d4a-a4a1f7a1cfd5 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1565 microversion: 2.1 time: 0.225879 May 23 10:55:02.279557 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 232/457] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:02 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1565 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:02.295429 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-39c5fed5-c3b7-4ef8-b71e-205bdb204f85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:02.295985 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-39c5fed5-c3b7-4ef8-b71e-205bdb204f85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:02.302661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-39c5fed5-c3b7-4ef8-b71e-205bdb204f85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:02.303181 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-39c5fed5-c3b7-4ef8-b71e-205bdb204f85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:02.304666 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-39c5fed5-c3b7-4ef8-b71e-205bdb204f85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:02.305110 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-39c5fed5-c3b7-4ef8-b71e-205bdb204f85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:02.384495 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-39c5fed5-c3b7-4ef8-b71e-205bdb204f85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092858 May 23 10:55:02.385792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 226/458] 10.222.0.36 () {58 vars in 1274 bytes} [Mon May 23 10:55:02 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:02.472857 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-464450542", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6500cd5-4edf-47aa-9e35-9691dad60917"}], "security_groups": [{"name": "tempest-securitygroup--1356142028"}], "key_name": "tempest-keypair-1077688309", "user_data": "}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:02.570968 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] validate_networks() for [('f6500cd5-4edf-47aa-9e35-9691dad60917', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:55:02.955739 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:55:02.956158 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:55:02.956631 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:55:02.957035 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:55:02.957445 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:55:02.966454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:02.966902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:02.967694 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:02.968129 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:02.985420 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:55:02.989473 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for user 8e98c8ceac6b47079423b45685c5ba3e and project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:55:02.999021 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:03.001725 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:55:03.004114 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:55:03.051180 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ed6d66c1-c775-4fa3-acc7-6c6b936a2f57 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.582553 May 23 10:55:03.051826 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 233/459] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:55:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:55:03.063999 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7cc9943f-9d4f-4d69-acd4-15c1632d093a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:03.065391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-7cc9943f-9d4f-4d69-acd4-15c1632d093a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:03.155204 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-7cc9943f-9d4f-4d69-acd4-15c1632d093a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:03.162662 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-7cc9943f-9d4f-4d69-acd4-15c1632d093a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1241 microversion: 2.1 time: 0.103688 May 23 10:55:03.163970 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 227/460] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:03 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:03.362833 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-379c5ec0-093d-416b-ba1b-d4bf4a0c2d62 req-f8cea23d-1c4e-4b1d-8b91-3ac12b7b1315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67badd04-43b7-41f4-88fc-c7435ac2f158", "tag": "9da49a79-8d41-4702-8f35-b66bc046212c"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:03.371866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-379c5ec0-093d-416b-ba1b-d4bf4a0c2d62 req-f8cea23d-1c4e-4b1d-8b91-3ac12b7b1315 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:03.372596 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-379c5ec0-093d-416b-ba1b-d4bf4a0c2d62 req-f8cea23d-1c4e-4b1d-8b91-3ac12b7b1315 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:03.384294 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-379c5ec0-093d-416b-ba1b-d4bf4a0c2d62 req-f8cea23d-1c4e-4b1d-8b91-3ac12b7b1315 service nova] Creating event network-changed:9da49a79-8d41-4702-8f35-b66bc046212c for instance 67badd04-43b7-41f4-88fc-c7435ac2f158 on hv-cinder-83699 May 23 10:55:03.389426 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-379c5ec0-093d-416b-ba1b-d4bf4a0c2d62 req-f8cea23d-1c4e-4b1d-8b91-3ac12b7b1315 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031056 May 23 10:55:03.390324 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 234/461] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:04.180940 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-efa6d9ab-d54f-4d69-b097-96528e481133 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:04.182204 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-efa6d9ab-d54f-4d69-b097-96528e481133 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:04.189247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-efa6d9ab-d54f-4d69-b097-96528e481133 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:04.189928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-efa6d9ab-d54f-4d69-b097-96528e481133 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:04.191000 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-efa6d9ab-d54f-4d69-b097-96528e481133 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:04.191623 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-efa6d9ab-d54f-4d69-b097-96528e481133 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:04.304328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-efa6d9ab-d54f-4d69-b097-96528e481133 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:04.317808 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-efa6d9ab-d54f-4d69-b097-96528e481133 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1301 microversion: 2.1 time: 0.140600 May 23 10:55:04.329211 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 228/462] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:04 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1301 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:05.338597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bc0ed34a-2116-4966-bf1b-c5e53fa81e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:05.339941 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bc0ed34a-2116-4966-bf1b-c5e53fa81e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:05.346786 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bc0ed34a-2116-4966-bf1b-c5e53fa81e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:05.347013 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bc0ed34a-2116-4966-bf1b-c5e53fa81e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:05.347788 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bc0ed34a-2116-4966-bf1b-c5e53fa81e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:05.348231 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bc0ed34a-2116-4966-bf1b-c5e53fa81e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:05.489900 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bc0ed34a-2116-4966-bf1b-c5e53fa81e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:05.497408 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bc0ed34a-2116-4966-bf1b-c5e53fa81e3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1367 microversion: 2.1 time: 0.164874 May 23 10:55:05.497996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 235/463] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:05 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:06.001617 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-15d59eb2-60d9-4572-9e7a-6351066bf0e1 req-4b578d43-c997-447a-8117-0210779257de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34bc626-48f7-41fe-9f92-2581c01532d9", "tag": "e5cbde79-dd3a-41b0-a7ff-4c188bf495b5"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:06.011124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-15d59eb2-60d9-4572-9e7a-6351066bf0e1 req-4b578d43-c997-447a-8117-0210779257de service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:06.011756 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-15d59eb2-60d9-4572-9e7a-6351066bf0e1 req-4b578d43-c997-447a-8117-0210779257de service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:06.036621 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-15d59eb2-60d9-4572-9e7a-6351066bf0e1 req-4b578d43-c997-447a-8117-0210779257de service nova] Creating event network-changed:e5cbde79-dd3a-41b0-a7ff-4c188bf495b5 for instance e34bc626-48f7-41fe-9f92-2581c01532d9 on hv-cinder-83699 May 23 10:55:06.041751 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-15d59eb2-60d9-4572-9e7a-6351066bf0e1 req-4b578d43-c997-447a-8117-0210779257de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044232 May 23 10:55:06.042532 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 229/464] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:06.513784 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e7fd9641-22d0-4216-a193-4d5de0470815 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:06.514417 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e7fd9641-22d0-4216-a193-4d5de0470815 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:06.521166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7fd9641-22d0-4216-a193-4d5de0470815 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:06.521615 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7fd9641-22d0-4216-a193-4d5de0470815 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:06.522408 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7fd9641-22d0-4216-a193-4d5de0470815 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:06.523353 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7fd9641-22d0-4216-a193-4d5de0470815 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:06.651924 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e7fd9641-22d0-4216-a193-4d5de0470815 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:06.655520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:06.660158 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e7fd9641-22d0-4216-a193-4d5de0470815 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1367 microversion: 2.1 time: 0.150214 May 23 10:55:06.660726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 236/465] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:06 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:07.677823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-97341a62-9bac-409c-aa24-6128386ccefd tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:07.678694 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-97341a62-9bac-409c-aa24-6128386ccefd tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:07.685136 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97341a62-9bac-409c-aa24-6128386ccefd tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:07.685594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97341a62-9bac-409c-aa24-6128386ccefd tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:07.686419 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97341a62-9bac-409c-aa24-6128386ccefd tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:07.686866 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-97341a62-9bac-409c-aa24-6128386ccefd tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:07.899693 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-97341a62-9bac-409c-aa24-6128386ccefd tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:07.908352 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-97341a62-9bac-409c-aa24-6128386ccefd tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1367 microversion: 2.1 time: 0.235210 May 23 10:55:07.908939 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 230/466] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:07 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:08.924447 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0ac95c2e-74c3-40a6-bb74-00d89e05a058 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:08.925052 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-0ac95c2e-74c3-40a6-bb74-00d89e05a058 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:08.932376 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0ac95c2e-74c3-40a6-bb74-00d89e05a058 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:08.932818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0ac95c2e-74c3-40a6-bb74-00d89e05a058 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:08.933575 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0ac95c2e-74c3-40a6-bb74-00d89e05a058 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:08.934064 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0ac95c2e-74c3-40a6-bb74-00d89e05a058 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:09.058348 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-0ac95c2e-74c3-40a6-bb74-00d89e05a058 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:09.065902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-0ac95c2e-74c3-40a6-bb74-00d89e05a058 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1367 microversion: 2.1 time: 0.145236 May 23 10:55:09.066487 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 237/467] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:08 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:09.620624 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-28b63afb-d349-4730-ac7e-1ff8e9750987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:09.621160 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-28b63afb-d349-4730-ac7e-1ff8e9750987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:09.627802 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-28b63afb-d349-4730-ac7e-1ff8e9750987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:09.628249 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-28b63afb-d349-4730-ac7e-1ff8e9750987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:09.629027 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-28b63afb-d349-4730-ac7e-1ff8e9750987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:09.629449 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-28b63afb-d349-4730-ac7e-1ff8e9750987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:09.660541 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-28b63afb-d349-4730-ac7e-1ff8e9750987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-volume_attachments/8df5f86f-57c4-4c49-8ffe-9e6010adb4dd" status: 200 len: 194 microversion: 2.20 time: 0.043897 May 23 10:55:09.661051 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 231/468] 10.222.0.36 () {60 vars in 1453 bytes} [Mon May 23 10:55:09 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-volume_attachments/8df5f86f-57c4-4c49-8ffe-9e6010adb4dd => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:55:09.723452 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d58971c5-9b2d-47a2-83e4-01a1afe06e56 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:09.723933 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d58971c5-9b2d-47a2-83e4-01a1afe06e56 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:09.730485 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d58971c5-9b2d-47a2-83e4-01a1afe06e56 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:09.730928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d58971c5-9b2d-47a2-83e4-01a1afe06e56 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:09.731685 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d58971c5-9b2d-47a2-83e4-01a1afe06e56 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:09.732119 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d58971c5-9b2d-47a2-83e4-01a1afe06e56 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:09.810584 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-d58971c5-9b2d-47a2-83e4-01a1afe06e56 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lazy-loading 'services' on Instance uuid 1e61941d-0058-4809-83b9-676d70df112a {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:55:09.879329 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d58971c5-9b2d-47a2-83e4-01a1afe06e56 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-volume_attachments/8df5f86f-57c4-4c49-8ffe-9e6010adb4dd" status: 202 len: 0 microversion: 2.20 time: 0.159634 May 23 10:55:09.879922 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 238/469] 10.222.0.36 () {60 vars in 1456 bytes} [Mon May 23 10:55:09 2022] DELETE /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-volume_attachments/8df5f86f-57c4-4c49-8ffe-9e6010adb4dd => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 10:55:09.888783 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7f92cbac-722d-4916-8f4e-af29de7216f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:09.889774 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-7f92cbac-722d-4916-8f4e-af29de7216f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:09.896697 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7f92cbac-722d-4916-8f4e-af29de7216f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:09.897145 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7f92cbac-722d-4916-8f4e-af29de7216f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:09.898570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7f92cbac-722d-4916-8f4e-af29de7216f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:09.899018 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7f92cbac-722d-4916-8f4e-af29de7216f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:09.929798 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-7f92cbac-722d-4916-8f4e-af29de7216f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044899 May 23 10:55:09.933772 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 232/470] 10.222.0.36 () {60 vars in 1342 bytes} [Mon May 23 10:55:09 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:55:10.083649 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-7cbc6af6-b54f-4013-ae1b-b2254479039f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:10.084349 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-7cbc6af6-b54f-4013-ae1b-b2254479039f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:10.091595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7cbc6af6-b54f-4013-ae1b-b2254479039f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:10.092139 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7cbc6af6-b54f-4013-ae1b-b2254479039f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:10.092892 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7cbc6af6-b54f-4013-ae1b-b2254479039f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:10.093351 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7cbc6af6-b54f-4013-ae1b-b2254479039f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:10.224805 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-7cbc6af6-b54f-4013-ae1b-b2254479039f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:10.232960 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-7cbc6af6-b54f-4013-ae1b-b2254479039f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1367 microversion: 2.1 time: 0.153553 May 23 10:55:10.233536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 239/471] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:10 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:10.941372 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-88f8f99c-a53c-46cf-a5f8-7fc8c312b3d8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:10.942326 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-88f8f99c-a53c-46cf-a5f8-7fc8c312b3d8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:10.948773 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-88f8f99c-a53c-46cf-a5f8-7fc8c312b3d8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:10.949225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-88f8f99c-a53c-46cf-a5f8-7fc8c312b3d8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:10.950019 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-88f8f99c-a53c-46cf-a5f8-7fc8c312b3d8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:10.950466 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-88f8f99c-a53c-46cf-a5f8-7fc8c312b3d8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:10.978868 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-88f8f99c-a53c-46cf-a5f8-7fc8c312b3d8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041474 May 23 10:55:10.979421 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 233/472] 10.222.0.36 () {60 vars in 1342 bytes} [Mon May 23 10:55:10 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:11.036364 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-209fa2fd-be2b-4ced-9206-3493d962c60f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:11.036855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-209fa2fd-be2b-4ced-9206-3493d962c60f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:11.043504 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-209fa2fd-be2b-4ced-9206-3493d962c60f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:11.043949 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-209fa2fd-be2b-4ced-9206-3493d962c60f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:11.044699 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-209fa2fd-be2b-4ced-9206-3493d962c60f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:11.045128 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-209fa2fd-be2b-4ced-9206-3493d962c60f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:11.069582 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-209fa2fd-be2b-4ced-9206-3493d962c60f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:55:11.142424 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-209fa2fd-be2b-4ced-9206-3493d962c60f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 204 len: 0 microversion: 2.20 time: 0.109359 May 23 10:55:11.144985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 240/473] 10.222.0.36 () {60 vars in 1279 bytes} [Mon May 23 10:55:11 2022] DELETE /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 10:55:11.152886 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e1c3f487-de43-4110-a1b3-5b2b8b3710d1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:11.153514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e1c3f487-de43-4110-a1b3-5b2b8b3710d1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:11.159582 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e1c3f487-de43-4110-a1b3-5b2b8b3710d1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:11.160052 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e1c3f487-de43-4110-a1b3-5b2b8b3710d1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:11.160802 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e1c3f487-de43-4110-a1b3-5b2b8b3710d1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:11.161241 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e1c3f487-de43-4110-a1b3-5b2b8b3710d1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:11.250394 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-83f108ba-2512-4cda-b228-75883cf80e54 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:11.251120 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-83f108ba-2512-4cda-b228-75883cf80e54 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:11.257905 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-83f108ba-2512-4cda-b228-75883cf80e54 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:11.258393 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-83f108ba-2512-4cda-b228-75883cf80e54 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:11.259161 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-83f108ba-2512-4cda-b228-75883cf80e54 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:11.259598 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-83f108ba-2512-4cda-b228-75883cf80e54 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:11.296163 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e1c3f487-de43-4110-a1b3-5b2b8b3710d1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:11.304629 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e1c3f487-de43-4110-a1b3-5b2b8b3710d1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:11.306150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e1c3f487-de43-4110-a1b3-5b2b8b3710d1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:11.307351 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e1c3f487-de43-4110-a1b3-5b2b8b3710d1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.158410 May 23 10:55:11.307917 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 234/474] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:11 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:11.387986 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-83f108ba-2512-4cda-b228-75883cf80e54 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:11.395590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-83f108ba-2512-4cda-b228-75883cf80e54 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1367 microversion: 2.1 time: 0.149241 May 23 10:55:11.396090 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 241/475] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:11 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:12.055225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-0aaf8118-05fb-42e0-bcb2-63c34436a081 req-77a56cfb-f26d-4974-8f3e-d30246fa7d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34bc626-48f7-41fe-9f92-2581c01532d9", "name": "network-vif-plugged", "status": "completed", "tag": "e5cbde79-dd3a-41b0-a7ff-4c188bf495b5"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:12.064669 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-0aaf8118-05fb-42e0-bcb2-63c34436a081 req-77a56cfb-f26d-4974-8f3e-d30246fa7d09 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:12.065217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-0aaf8118-05fb-42e0-bcb2-63c34436a081 req-77a56cfb-f26d-4974-8f3e-d30246fa7d09 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:12.077706 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-0aaf8118-05fb-42e0-bcb2-63c34436a081 req-77a56cfb-f26d-4974-8f3e-d30246fa7d09 service nova] Creating event network-vif-plugged:e5cbde79-dd3a-41b0-a7ff-4c188bf495b5 for instance e34bc626-48f7-41fe-9f92-2581c01532d9 on hv-cinder-83699 May 23 10:55:12.082633 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-0aaf8118-05fb-42e0-bcb2-63c34436a081 req-77a56cfb-f26d-4974-8f3e-d30246fa7d09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030959 May 23 10:55:12.083268 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 235/476] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:12.326386 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b3d6061f-e46e-47b7-96b9-1de80323b67a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:12.327029 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b3d6061f-e46e-47b7-96b9-1de80323b67a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:12.333464 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b3d6061f-e46e-47b7-96b9-1de80323b67a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:12.333919 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b3d6061f-e46e-47b7-96b9-1de80323b67a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:12.334715 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b3d6061f-e46e-47b7-96b9-1de80323b67a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:12.335736 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b3d6061f-e46e-47b7-96b9-1de80323b67a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:12.412244 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-90ff22ad-d1e1-4b3b-b08b-88f81ebaa644 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:12.413060 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-90ff22ad-d1e1-4b3b-b08b-88f81ebaa644 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:12.419392 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90ff22ad-d1e1-4b3b-b08b-88f81ebaa644 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:12.419848 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90ff22ad-d1e1-4b3b-b08b-88f81ebaa644 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:12.420614 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90ff22ad-d1e1-4b3b-b08b-88f81ebaa644 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:12.421054 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90ff22ad-d1e1-4b3b-b08b-88f81ebaa644 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:12.468523 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b3d6061f-e46e-47b7-96b9-1de80323b67a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:12.477031 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b3d6061f-e46e-47b7-96b9-1de80323b67a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:12.478593 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b3d6061f-e46e-47b7-96b9-1de80323b67a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:12.479747 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b3d6061f-e46e-47b7-96b9-1de80323b67a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.157447 May 23 10:55:12.480306 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 242/477] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:12 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:12.550533 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-90ff22ad-d1e1-4b3b-b08b-88f81ebaa644 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:12.557820 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-90ff22ad-d1e1-4b3b-b08b-88f81ebaa644 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1367 microversion: 2.1 time: 0.149836 May 23 10:55:12.558577 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 236/478] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:12 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:55:13.499349 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-57eab5c3-cf68-4494-af95-b0700f35e19a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:13.500107 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-57eab5c3-cf68-4494-af95-b0700f35e19a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:13.502153 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:13.502973 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=6 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:13.509246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-57eab5c3-cf68-4494-af95-b0700f35e19a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:13.509728 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-57eab5c3-cf68-4494-af95-b0700f35e19a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:13.510687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-57eab5c3-cf68-4494-af95-b0700f35e19a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:13.511124 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-57eab5c3-cf68-4494-af95-b0700f35e19a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:13.575291 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a4f36049-a9e6-4e83-b16f-d10c61c65ac9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:13.576000 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a4f36049-a9e6-4e83-b16f-d10c61c65ac9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:13.578560 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=6 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:13.584426 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4f36049-a9e6-4e83-b16f-d10c61c65ac9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:13.584969 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4f36049-a9e6-4e83-b16f-d10c61c65ac9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:13.585814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4f36049-a9e6-4e83-b16f-d10c61c65ac9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:13.586503 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4f36049-a9e6-4e83-b16f-d10c61c65ac9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:13.646531 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-57eab5c3-cf68-4494-af95-b0700f35e19a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:13.660807 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-57eab5c3-cf68-4494-af95-b0700f35e19a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:13.662391 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-57eab5c3-cf68-4494-af95-b0700f35e19a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:13.664091 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-57eab5c3-cf68-4494-af95-b0700f35e19a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1722 microversion: 2.20 time: 0.168653 May 23 10:55:13.664652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 243/479] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:13 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:13.784597 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a4f36049-a9e6-4e83-b16f-d10c61c65ac9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:13.795111 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a4f36049-a9e6-4e83-b16f-d10c61c65ac9 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1367 microversion: 2.1 time: 0.223501 May 23 10:55:13.806394 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 237/480] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:13 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:55:14.045257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-feeb17d5-5050-4bb8-865b-30aaa8c9c06c req-0c303b0f-5633-4407-8774-ace092648a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61941d-0058-4809-83b9-676d70df112a", "name": "network-vif-deleted", "tag": "5b53bf83-661d-4063-8ac0-99bf4069b7ab"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:14.054621 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-feeb17d5-5050-4bb8-865b-30aaa8c9c06c req-0c303b0f-5633-4407-8774-ace092648a62 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:14.055009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-feeb17d5-5050-4bb8-865b-30aaa8c9c06c req-0c303b0f-5633-4407-8774-ace092648a62 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:14.067005 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-feeb17d5-5050-4bb8-865b-30aaa8c9c06c req-0c303b0f-5633-4407-8774-ace092648a62 service nova] Creating event network-vif-deleted:5b53bf83-661d-4063-8ac0-99bf4069b7ab for instance 1e61941d-0058-4809-83b9-676d70df112a on hv-cinder-83699 May 23 10:55:14.072356 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-feeb17d5-5050-4bb8-865b-30aaa8c9c06c req-0c303b0f-5633-4407-8774-ace092648a62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030711 May 23 10:55:14.073132 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 244/481] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:14.682751 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:14.683268 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:14.689844 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:14.690329 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:14.691106 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:14.691548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:14.722521 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:14.723140 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:14.723425 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lazy-loading 'fault' on Instance uuid 1e61941d-0058-4809-83b9-676d70df112a {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:55:14.769867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:14.779448 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:14.781050 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:14.782459 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f5364e04-ebf7-4548-84d4-b78adb15bcf7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 200 len: 1370 microversion: 2.20 time: 0.103706 May 23 10:55:14.790132 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 238/482] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:14 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:14.819971 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a7d1febc-09d2-4b5e-90ad-b8216d08bcb3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:14.821047 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a7d1febc-09d2-4b5e-90ad-b8216d08bcb3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:14.827566 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a7d1febc-09d2-4b5e-90ad-b8216d08bcb3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:14.828091 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a7d1febc-09d2-4b5e-90ad-b8216d08bcb3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:14.829119 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a7d1febc-09d2-4b5e-90ad-b8216d08bcb3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:14.829763 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a7d1febc-09d2-4b5e-90ad-b8216d08bcb3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:14.968365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a7d1febc-09d2-4b5e-90ad-b8216d08bcb3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:14.976535 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a7d1febc-09d2-4b5e-90ad-b8216d08bcb3 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1556 microversion: 2.1 time: 0.161782 May 23 10:55:14.977097 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 245/483] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:14 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:14.992761 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6d5ef7e0-6a9c-488b-8125-b9009abd8c1d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:14.993260 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6d5ef7e0-6a9c-488b-8125-b9009abd8c1d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:14.999190 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6d5ef7e0-6a9c-488b-8125-b9009abd8c1d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:14.999643 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6d5ef7e0-6a9c-488b-8125-b9009abd8c1d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:15.000408 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6d5ef7e0-6a9c-488b-8125-b9009abd8c1d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:15.000854 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6d5ef7e0-6a9c-488b-8125-b9009abd8c1d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:15.079720 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6d5ef7e0-6a9c-488b-8125-b9009abd8c1d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090784 May 23 10:55:15.080567 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 239/484] 10.222.0.36 () {58 vars in 1274 bytes} [Mon May 23 10:55:14 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:15.801188 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-58e1e4e9-0ef1-4636-9f52-f0f57cc7407f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:15.801705 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-58e1e4e9-0ef1-4636-9f52-f0f57cc7407f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:15.808351 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-58e1e4e9-0ef1-4636-9f52-f0f57cc7407f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:15.808801 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-58e1e4e9-0ef1-4636-9f52-f0f57cc7407f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:15.809562 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-58e1e4e9-0ef1-4636-9f52-f0f57cc7407f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:15.810026 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-58e1e4e9-0ef1-4636-9f52-f0f57cc7407f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:15.823843 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-58e1e4e9-0ef1-4636-9f52-f0f57cc7407f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] HTTP exception thrown: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-58e1e4e9-0ef1-4636-9f52-f0f57cc7407f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Request method failure captured: May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a HTTP/1.1 May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGQ-taUV273wcrPo7QFxmjbMSZe3CFgxNJ6WMkptLf_Uo47YaiNZ7DXCC_9KnxOh7uxvoca5-HrzbclkVhwcBHKXVyI1AjQJbIWIncRdEHpd-JGN07y58jfbBxrETtCfRz6vT-nYumCl4C7Ce85TdEpvKWe66rVyuDE-y0_Ox-wLc May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Openstack-Nova-Api-Version: 2.20 May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:55:15.825493 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2c669b26bf1845a6a3b35eb551ebcb98", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 7433cc7ed66f4e609332c56c936487e8 May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:55:15.826928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '1e61941d-0058-4809-83b9-676d70df112a'} May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:55:15.827677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:55:15.828952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:15.830092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-58e1e4e9-0ef1-4636-9f52-f0f57cc7407f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Returning 404 to user: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:55:15.830092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-58e1e4e9-0ef1-4636-9f52-f0f57cc7407f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 404 len: 111 microversion: 2.20 time: 0.029721 May 23 10:55:15.830092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 246/485] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:15 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 10:55:15.836337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f1f56146-a314-4bb6-a1da-fb78613e4116 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '.version_select at 0x7fe7201fa8b0>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:15.853601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f1f56146-a314-4bb6-a1da-fb78613e4116 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-766572678" status: 204 len: 0 microversion: 2.20 time: 0.021489 May 23 10:55:15.854231 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 240/486] 10.222.0.36 () {60 vars in 1258 bytes} [Mon May 23 10:55:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-766572678 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 10:55:16.215503 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-7cfa6238-384f-4d7a-b9d0-85e71398f48c req-3c3effeb-cd37-4953-ad1b-487356c25964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34bc626-48f7-41fe-9f92-2581c01532d9", "tag": "e5cbde79-dd3a-41b0-a7ff-4c188bf495b5"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:16.223767 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-7cfa6238-384f-4d7a-b9d0-85e71398f48c req-3c3effeb-cd37-4953-ad1b-487356c25964 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:16.224470 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-7cfa6238-384f-4d7a-b9d0-85e71398f48c req-3c3effeb-cd37-4953-ad1b-487356c25964 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:16.238943 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-7cfa6238-384f-4d7a-b9d0-85e71398f48c req-3c3effeb-cd37-4953-ad1b-487356c25964 service nova] Creating event network-changed:e5cbde79-dd3a-41b0-a7ff-4c188bf495b5 for instance e34bc626-48f7-41fe-9f92-2581c01532d9 on hv-cinder-83699 May 23 10:55:16.246016 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-7cfa6238-384f-4d7a-b9d0-85e71398f48c req-3c3effeb-cd37-4953-ad1b-487356c25964 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033116 May 23 10:55:16.247296 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 247/487] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:16.519343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-cd75e594-99b1-42df-866e-4a0281ece7dc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Action: 'create', calling method: .version_select at 0x7fe7200149d0>, body: {"keypair": {"name": "tempest-keypair-1265172538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRbs9ecdg9j7iO6+GdxxgRyh0A42IeX+CzOsYbNklrnGulRFyV5Kpd4elxMnfbg2wwm+JURY6da1HMyxEn6bAb/3ghqPNUm5qLILBLWB0gbNbXFmSpHMUZNhC7eKrog4A=="}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:16.535198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-cd75e594-99b1-42df-866e-4a0281ece7dc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Getting quotas for project 2c669b26bf1845a6a3b35eb551ebcb98. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:55:16.539254 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-cd75e594-99b1-42df-866e-4a0281ece7dc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Getting quotas for user 7433cc7ed66f4e609332c56c936487e8 and project 2c669b26bf1845a6a3b35eb551ebcb98. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:55:16.548534 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:16.567843 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-cd75e594-99b1-42df-866e-4a0281ece7dc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052379 May 23 10:55:16.574639 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 241/488] 10.222.0.36 () {62 vars in 1199 bytes} [Mon May 23 10:55:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 23 10:55:18.212011 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1159306231", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d9bbc8d-a3c4-4810-9114-b7a4b20eeef1"}], "security_groups": [{"name": "tempest-securitygroup--147295517"}], "key_name": "tempest-keypair-1265172538", "user_data": "}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:18.310803 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] validate_networks() for [('9d9bbc8d-a3c4-4810-9114-b7a4b20eeef1', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:55:18.664610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:55:18.665180 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:55:18.665695 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:55:18.666283 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:55:18.666701 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:55:18.675644 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:18.676094 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:18.676891 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:18.677329 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:18.694643 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Getting quotas for project 2c669b26bf1845a6a3b35eb551ebcb98. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:55:18.698585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Getting quotas for user 7433cc7ed66f4e609332c56c936487e8 and project 2c669b26bf1845a6a3b35eb551ebcb98. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:55:18.709306 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:55:18.711706 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:55:18.757754 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-59a384c5-e854-4875-9e3e-3f41ecc45ae4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.551355 May 23 10:55:18.758363 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 248/489] 10.222.0.36 () {62 vars in 1187 bytes} [Mon May 23 10:55:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 10:55:18.768889 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-553a3cc7-4ee4-4679-9183-a8a3022ba5e1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:18.769503 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-553a3cc7-4ee4-4679-9183-a8a3022ba5e1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:18.824926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-553a3cc7-4ee4-4679-9183-a8a3022ba5e1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:18.832156 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-553a3cc7-4ee4-4679-9183-a8a3022ba5e1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:18.833652 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-553a3cc7-4ee4-4679-9183-a8a3022ba5e1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:18.834790 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-553a3cc7-4ee4-4679-9183-a8a3022ba5e1 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1282 microversion: 2.20 time: 0.070223 May 23 10:55:18.835406 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 242/490] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:18 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:19.853755 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cdf62217-d64c-4de1-8edb-8366e22cd253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:19.854602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-cdf62217-d64c-4de1-8edb-8366e22cd253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:19.861717 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cdf62217-d64c-4de1-8edb-8366e22cd253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:19.862281 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cdf62217-d64c-4de1-8edb-8366e22cd253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:19.863184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cdf62217-d64c-4de1-8edb-8366e22cd253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:19.863692 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cdf62217-d64c-4de1-8edb-8366e22cd253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:19.930316 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-cdf62217-d64c-4de1-8edb-8366e22cd253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:19.939257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-cdf62217-d64c-4de1-8edb-8366e22cd253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:19.940782 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-cdf62217-d64c-4de1-8edb-8366e22cd253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:19.941881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-cdf62217-d64c-4de1-8edb-8366e22cd253 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1342 microversion: 2.20 time: 0.093263 May 23 10:55:19.942726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 249/491] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:19 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1342 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:55:20.960454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-33e54506-a9a5-466d-a6a4-dfa2cd9ff060 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:20.961066 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-33e54506-a9a5-466d-a6a4-dfa2cd9ff060 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:20.967803 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-33e54506-a9a5-466d-a6a4-dfa2cd9ff060 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:20.968329 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-33e54506-a9a5-466d-a6a4-dfa2cd9ff060 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:20.969185 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-33e54506-a9a5-466d-a6a4-dfa2cd9ff060 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:20.969683 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-33e54506-a9a5-466d-a6a4-dfa2cd9ff060 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:21.185431 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-33e54506-a9a5-466d-a6a4-dfa2cd9ff060 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:21.197603 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-33e54506-a9a5-466d-a6a4-dfa2cd9ff060 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:21.199986 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-33e54506-a9a5-466d-a6a4-dfa2cd9ff060 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:21.203659 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-33e54506-a9a5-466d-a6a4-dfa2cd9ff060 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1407 microversion: 2.20 time: 0.244859 May 23 10:55:21.205465 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 243/492] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:20 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:21.416884 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-3fb6273a-2773-4bee-b71f-47e6cec4cd67 req-2ecf1594-a1d9-4e40-be95-ff90fb6d2c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde224c6-c41a-4424-8bc4-bd8f62d9fa53", "tag": "40b35beb-6f47-44de-835b-56925cd7ae0f"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:21.433333 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-3fb6273a-2773-4bee-b71f-47e6cec4cd67 req-2ecf1594-a1d9-4e40-be95-ff90fb6d2c7d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:21.434486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-3fb6273a-2773-4bee-b71f-47e6cec4cd67 req-2ecf1594-a1d9-4e40-be95-ff90fb6d2c7d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:21.456681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-3fb6273a-2773-4bee-b71f-47e6cec4cd67 req-2ecf1594-a1d9-4e40-be95-ff90fb6d2c7d service nova] Creating event network-changed:40b35beb-6f47-44de-835b-56925cd7ae0f for instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 on hv-cinder-83699 May 23 10:55:21.461660 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-3fb6273a-2773-4bee-b71f-47e6cec4cd67 req-2ecf1594-a1d9-4e40-be95-ff90fb6d2c7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056177 May 23 10:55:21.462304 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 250/493] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:22.223110 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-043f6124-bdd5-48d6-bf2c-8805079b57ee tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:22.223669 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-043f6124-bdd5-48d6-bf2c-8805079b57ee tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:22.230342 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-043f6124-bdd5-48d6-bf2c-8805079b57ee tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:22.230800 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-043f6124-bdd5-48d6-bf2c-8805079b57ee tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:22.231571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-043f6124-bdd5-48d6-bf2c-8805079b57ee tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:22.232011 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-043f6124-bdd5-48d6-bf2c-8805079b57ee tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:22.365045 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-043f6124-bdd5-48d6-bf2c-8805079b57ee tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:22.373376 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-043f6124-bdd5-48d6-bf2c-8805079b57ee tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:22.374946 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-043f6124-bdd5-48d6-bf2c-8805079b57ee tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:22.376035 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-043f6124-bdd5-48d6-bf2c-8805079b57ee tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1407 microversion: 2.20 time: 0.156956 May 23 10:55:22.376601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 244/494] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:22 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:23.394540 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-01eef12c-49c1-4032-8f4f-481c09c9b7a4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:23.395237 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-01eef12c-49c1-4032-8f4f-481c09c9b7a4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:23.402721 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-01eef12c-49c1-4032-8f4f-481c09c9b7a4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:23.403171 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-01eef12c-49c1-4032-8f4f-481c09c9b7a4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:23.403942 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-01eef12c-49c1-4032-8f4f-481c09c9b7a4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:23.404408 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-01eef12c-49c1-4032-8f4f-481c09c9b7a4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:23.532809 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-01eef12c-49c1-4032-8f4f-481c09c9b7a4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:23.540656 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-01eef12c-49c1-4032-8f4f-481c09c9b7a4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:23.542177 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-01eef12c-49c1-4032-8f4f-481c09c9b7a4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:23.543278 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-01eef12c-49c1-4032-8f4f-481c09c9b7a4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1407 microversion: 2.20 time: 0.153141 May 23 10:55:23.543854 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 251/495] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:23 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:24.561122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-63568d4b-19e8-45e3-803a-32de3dae9251 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:24.561730 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-63568d4b-19e8-45e3-803a-32de3dae9251 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:24.568279 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-63568d4b-19e8-45e3-803a-32de3dae9251 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:24.568731 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-63568d4b-19e8-45e3-803a-32de3dae9251 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:24.569499 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-63568d4b-19e8-45e3-803a-32de3dae9251 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:24.569936 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-63568d4b-19e8-45e3-803a-32de3dae9251 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:24.573812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=100 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:24.698630 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-63568d4b-19e8-45e3-803a-32de3dae9251 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:24.706413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-63568d4b-19e8-45e3-803a-32de3dae9251 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:24.707909 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-63568d4b-19e8-45e3-803a-32de3dae9251 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:24.709009 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-63568d4b-19e8-45e3-803a-32de3dae9251 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1407 microversion: 2.20 time: 0.151771 May 23 10:55:24.710134 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 245/496] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:24 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:25.726691 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-89a0759e-ed64-420a-a946-a935e578149f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:25.727298 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-89a0759e-ed64-420a-a946-a935e578149f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:25.733791 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-89a0759e-ed64-420a-a946-a935e578149f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:25.734273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-89a0759e-ed64-420a-a946-a935e578149f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:25.735044 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-89a0759e-ed64-420a-a946-a935e578149f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:25.735481 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-89a0759e-ed64-420a-a946-a935e578149f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:25.865215 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-89a0759e-ed64-420a-a946-a935e578149f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:25.873655 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-89a0759e-ed64-420a-a946-a935e578149f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:25.875172 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-89a0759e-ed64-420a-a946-a935e578149f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:25.876265 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-89a0759e-ed64-420a-a946-a935e578149f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1407 microversion: 2.20 time: 0.153473 May 23 10:55:25.876814 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 252/497] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:25 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:26.894859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8664605c-2f67-4d59-a1c5-991b5a05b3a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:26.895644 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8664605c-2f67-4d59-a1c5-991b5a05b3a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:26.901803 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8664605c-2f67-4d59-a1c5-991b5a05b3a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:26.902290 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8664605c-2f67-4d59-a1c5-991b5a05b3a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:26.903055 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8664605c-2f67-4d59-a1c5-991b5a05b3a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:26.903492 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8664605c-2f67-4d59-a1c5-991b5a05b3a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:27.025962 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8664605c-2f67-4d59-a1c5-991b5a05b3a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:27.033724 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8664605c-2f67-4d59-a1c5-991b5a05b3a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:27.035258 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8664605c-2f67-4d59-a1c5-991b5a05b3a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:27.036357 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8664605c-2f67-4d59-a1c5-991b5a05b3a6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1407 microversion: 2.20 time: 0.145625 May 23 10:55:27.036918 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 246/498] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:26 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:28.055322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2bf1e0a8-ea5b-4165-bd4e-bbecec930f8f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:28.055937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2bf1e0a8-ea5b-4165-bd4e-bbecec930f8f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:28.063257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2bf1e0a8-ea5b-4165-bd4e-bbecec930f8f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:28.063738 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2bf1e0a8-ea5b-4165-bd4e-bbecec930f8f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:28.064580 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2bf1e0a8-ea5b-4165-bd4e-bbecec930f8f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:28.064953 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2bf1e0a8-ea5b-4165-bd4e-bbecec930f8f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:28.151275 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-8968dcf2-074a-4422-a93d-c4e7ec7b2a90 req-48a85b5e-22b9-4363-ae27-237e7d916ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde224c6-c41a-4424-8bc4-bd8f62d9fa53", "name": "network-vif-plugged", "status": "completed", "tag": "40b35beb-6f47-44de-835b-56925cd7ae0f"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:28.160788 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-8968dcf2-074a-4422-a93d-c4e7ec7b2a90 req-48a85b5e-22b9-4363-ae27-237e7d916ad6 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:28.161334 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-8968dcf2-074a-4422-a93d-c4e7ec7b2a90 req-48a85b5e-22b9-4363-ae27-237e7d916ad6 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:28.175250 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-8968dcf2-074a-4422-a93d-c4e7ec7b2a90 req-48a85b5e-22b9-4363-ae27-237e7d916ad6 service nova] Creating event network-vif-plugged:40b35beb-6f47-44de-835b-56925cd7ae0f for instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 on hv-cinder-83699 May 23 10:55:28.181368 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-8968dcf2-074a-4422-a93d-c4e7ec7b2a90 req-48a85b5e-22b9-4363-ae27-237e7d916ad6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036026 May 23 10:55:28.182120 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 247/499] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:28.200824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2bf1e0a8-ea5b-4165-bd4e-bbecec930f8f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:28.209752 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2bf1e0a8-ea5b-4165-bd4e-bbecec930f8f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:28.211294 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2bf1e0a8-ea5b-4165-bd4e-bbecec930f8f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:28.212432 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2bf1e0a8-ea5b-4165-bd4e-bbecec930f8f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1407 microversion: 2.20 time: 0.161578 May 23 10:55:28.212986 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 253/500] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:28 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:29.231865 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-29377f1d-057f-419c-b27a-92f877017cfb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:29.232639 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-29377f1d-057f-419c-b27a-92f877017cfb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:29.234617 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=6 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:29.240611 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-29377f1d-057f-419c-b27a-92f877017cfb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:29.241053 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-29377f1d-057f-419c-b27a-92f877017cfb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:29.241826 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-29377f1d-057f-419c-b27a-92f877017cfb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:29.242284 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-29377f1d-057f-419c-b27a-92f877017cfb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:29.370566 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-29377f1d-057f-419c-b27a-92f877017cfb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:29.378419 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-29377f1d-057f-419c-b27a-92f877017cfb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:29.379933 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-29377f1d-057f-419c-b27a-92f877017cfb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:29.381023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-29377f1d-057f-419c-b27a-92f877017cfb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1407 microversion: 2.20 time: 0.153690 May 23 10:55:29.381584 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 248/501] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:29 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:30.398958 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2a0f9069-349b-48a7-81e2-52da80e72662 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:30.399594 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2a0f9069-349b-48a7-81e2-52da80e72662 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:30.401548 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:30.402233 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=6 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:30.408782 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2a0f9069-349b-48a7-81e2-52da80e72662 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:30.409228 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2a0f9069-349b-48a7-81e2-52da80e72662 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:30.410019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2a0f9069-349b-48a7-81e2-52da80e72662 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:30.410457 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2a0f9069-349b-48a7-81e2-52da80e72662 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:30.427484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:30.537072 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2a0f9069-349b-48a7-81e2-52da80e72662 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:30.544842 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2a0f9069-349b-48a7-81e2-52da80e72662 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:30.546361 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2a0f9069-349b-48a7-81e2-52da80e72662 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:30.547508 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2a0f9069-349b-48a7-81e2-52da80e72662 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1600 microversion: 2.20 time: 0.152674 May 23 10:55:30.548069 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 254/502] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:55:30 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:55:30.565015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-86be10d8-5911-4522-ac41-81e1c7830bdd tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:30.565527 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-86be10d8-5911-4522-ac41-81e1c7830bdd tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:30.572606 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86be10d8-5911-4522-ac41-81e1c7830bdd tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:30.573051 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86be10d8-5911-4522-ac41-81e1c7830bdd tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:30.573804 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86be10d8-5911-4522-ac41-81e1c7830bdd tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:30.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86be10d8-5911-4522-ac41-81e1c7830bdd tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:30.649080 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-86be10d8-5911-4522-ac41-81e1c7830bdd tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087782 May 23 10:55:30.649615 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 249/503] 10.222.0.36 () {60 vars in 1315 bytes} [Mon May 23 10:55:30 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:55:31.763909 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-477ce237-188a-4c2a-99f3-6f470609e42f req-ffbdfb99-6dd0-4054-a753-87c4dcc3d7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde224c6-c41a-4424-8bc4-bd8f62d9fa53", "tag": "40b35beb-6f47-44de-835b-56925cd7ae0f"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:31.772721 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-477ce237-188a-4c2a-99f3-6f470609e42f req-ffbdfb99-6dd0-4054-a753-87c4dcc3d7ee service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:31.773163 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-477ce237-188a-4c2a-99f3-6f470609e42f req-ffbdfb99-6dd0-4054-a753-87c4dcc3d7ee service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:31.783884 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-477ce237-188a-4c2a-99f3-6f470609e42f req-ffbdfb99-6dd0-4054-a753-87c4dcc3d7ee service nova] Creating event network-changed:40b35beb-6f47-44de-835b-56925cd7ae0f for instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 on hv-cinder-83699 May 23 10:55:31.788866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-477ce237-188a-4c2a-99f3-6f470609e42f req-ffbdfb99-6dd0-4054-a753-87c4dcc3d7ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028784 May 23 10:55:31.789444 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 255/504] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:40.924274 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:40.925023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=22 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:40.929338 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8dcf445a-6c16-4924-a328-9ff1e1dbf411 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:40.930377 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8dcf445a-6c16-4924-a328-9ff1e1dbf411 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:40.937604 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8dcf445a-6c16-4924-a328-9ff1e1dbf411 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:40.938082 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8dcf445a-6c16-4924-a328-9ff1e1dbf411 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:40.938851 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8dcf445a-6c16-4924-a328-9ff1e1dbf411 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:40.939286 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8dcf445a-6c16-4924-a328-9ff1e1dbf411 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:40.967954 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8dcf445a-6c16-4924-a328-9ff1e1dbf411 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045045 May 23 10:55:40.968503 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 250/505] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:55:40 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 10:55:41.030732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2814bcd6-7ca1-44ee-8deb-c661f2265895 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:41.031317 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2814bcd6-7ca1-44ee-8deb-c661f2265895 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:41.033235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:41.038651 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2814bcd6-7ca1-44ee-8deb-c661f2265895 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:41.039105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2814bcd6-7ca1-44ee-8deb-c661f2265895 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:41.039870 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2814bcd6-7ca1-44ee-8deb-c661f2265895 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:41.040311 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2814bcd6-7ca1-44ee-8deb-c661f2265895 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:41.069478 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2814bcd6-7ca1-44ee-8deb-c661f2265895 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:55:41.141764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2814bcd6-7ca1-44ee-8deb-c661f2265895 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 204 len: 0 microversion: 2.1 time: 0.115570 May 23 10:55:41.142490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 256/506] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:55:41 2022] DELETE /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:55:41.151253 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e141e040-b676-4632-adb3-94da8ed38322 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:41.151858 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e141e040-b676-4632-adb3-94da8ed38322 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:41.158924 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e141e040-b676-4632-adb3-94da8ed38322 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:41.159369 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e141e040-b676-4632-adb3-94da8ed38322 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:41.160177 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e141e040-b676-4632-adb3-94da8ed38322 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:41.160615 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e141e040-b676-4632-adb3-94da8ed38322 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:41.288586 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e141e040-b676-4632-adb3-94da8ed38322 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:41.296142 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e141e040-b676-4632-adb3-94da8ed38322 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1673 microversion: 2.1 time: 0.149073 May 23 10:55:41.296719 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 251/507] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:41 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:42.313111 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3e08d36b-5707-49dc-8a54-5db8d3f1be47 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:42.313799 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3e08d36b-5707-49dc-8a54-5db8d3f1be47 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:42.321083 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3e08d36b-5707-49dc-8a54-5db8d3f1be47 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:42.321528 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3e08d36b-5707-49dc-8a54-5db8d3f1be47 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:42.322396 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3e08d36b-5707-49dc-8a54-5db8d3f1be47 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:42.322832 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3e08d36b-5707-49dc-8a54-5db8d3f1be47 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:42.450295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3e08d36b-5707-49dc-8a54-5db8d3f1be47 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:42.457773 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3e08d36b-5707-49dc-8a54-5db8d3f1be47 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1673 microversion: 2.1 time: 0.148856 May 23 10:55:42.458366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 257/508] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:42 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:43.474037 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e56508ab-2ff6-4cb8-873a-ecb79b497b1a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:43.475279 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e56508ab-2ff6-4cb8-873a-ecb79b497b1a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:43.481835 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e56508ab-2ff6-4cb8-873a-ecb79b497b1a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:43.482318 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e56508ab-2ff6-4cb8-873a-ecb79b497b1a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:43.483090 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e56508ab-2ff6-4cb8-873a-ecb79b497b1a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:43.483530 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e56508ab-2ff6-4cb8-873a-ecb79b497b1a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:43.607298 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e56508ab-2ff6-4cb8-873a-ecb79b497b1a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:43.614901 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e56508ab-2ff6-4cb8-873a-ecb79b497b1a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1673 microversion: 2.1 time: 0.144733 May 23 10:55:43.615474 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 252/509] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:43 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:44.594083 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-a134ae88-797b-4d6c-b1ce-3026aef5baa2 req-01244945-f184-46bb-962a-7aedbf8ec7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4944e0-e16e-4fc7-af6e-bfc128b079a8", "name": "network-vif-deleted", "tag": "fce62cd8-1ee5-4e76-b0ca-355710d5ec05"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:44.604105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-a134ae88-797b-4d6c-b1ce-3026aef5baa2 req-01244945-f184-46bb-962a-7aedbf8ec7f4 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:44.604631 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-a134ae88-797b-4d6c-b1ce-3026aef5baa2 req-01244945-f184-46bb-962a-7aedbf8ec7f4 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:44.619219 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-a134ae88-797b-4d6c-b1ce-3026aef5baa2 req-01244945-f184-46bb-962a-7aedbf8ec7f4 service nova] Creating event network-vif-deleted:fce62cd8-1ee5-4e76-b0ca-355710d5ec05 for instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 on hv-cinder-83699 May 23 10:55:44.625876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-a134ae88-797b-4d6c-b1ce-3026aef5baa2 req-01244945-f184-46bb-962a-7aedbf8ec7f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035896 May 23 10:55:44.626816 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 258/510] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:44.632818 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1ab4a97b-1139-4909-bf96-4ea743d4996d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:44.633692 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1ab4a97b-1139-4909-bf96-4ea743d4996d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:44.640200 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ab4a97b-1139-4909-bf96-4ea743d4996d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:44.640644 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ab4a97b-1139-4909-bf96-4ea743d4996d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:44.641418 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ab4a97b-1139-4909-bf96-4ea743d4996d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:44.641852 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ab4a97b-1139-4909-bf96-4ea743d4996d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:44.709246 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1ab4a97b-1139-4909-bf96-4ea743d4996d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:44.718344 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1ab4a97b-1139-4909-bf96-4ea743d4996d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 200 len: 1321 microversion: 2.1 time: 0.090043 May 23 10:55:44.722094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 253/511] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:44 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 1321 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:45.736551 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2c20325d-7443-4571-803d-bdbe021eca10 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:45.737244 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2c20325d-7443-4571-803d-bdbe021eca10 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:45.743895 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2c20325d-7443-4571-803d-bdbe021eca10 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:45.744340 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2c20325d-7443-4571-803d-bdbe021eca10 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:45.745101 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2c20325d-7443-4571-803d-bdbe021eca10 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:45.745535 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2c20325d-7443-4571-803d-bdbe021eca10 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:45.758830 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-2c20325d-7443-4571-803d-bdbe021eca10 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] HTTP exception thrown: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2c20325d-7443-4571-803d-bdbe021eca10 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Request method failure captured: May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 HTTP/1.1 May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dCFcFqXq8b907zUpLlmRr5-RUrAOAWaYlzJWyyEWlYabqPEH2Lpu7WoZoU35ImXoeg3o69t6eta2Iqxnzx-5Tz8K3zmNwKu287wnOrByYhvJu_dcvtIprkSRE_03bp_VwD5BFdr6n4SZI3GeNKKyREDTpe1V8QUiBui4bJ9_YhrPk May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:55:45.760404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d45f08040d949bd8949e3d1faab25c4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeTestJSON-624332084 May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeTestJSON-624332084-project May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: a1fc33c4ee0c4b30a862f6685817bdf4 May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeTestJSON-624332084-project May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:55:45.761937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '6e4944e0-e16e-4fc7-af6e-bfc128b079a8'} May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:55:45.762985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:55:45.764496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:55:45.765724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2c20325d-7443-4571-803d-bdbe021eca10 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Returning 404 to user: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:55:45.765724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2c20325d-7443-4571-803d-bdbe021eca10 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 404 len: 111 microversion: 2.1 time: 0.029450 May 23 10:55:45.765724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 259/512] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:45 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:55:45.770860 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-742ea708-7136-44f7-ae72-37fa1c8686f9 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '.version_select at 0x7fe7200219d0>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:45.788404 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-742ea708-7136-44f7-ae72-37fa1c8686f9 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609502394" status: 202 len: 0 microversion: 2.1 time: 0.021588 May 23 10:55:45.788978 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 254/513] 10.222.0.36 () {58 vars in 1217 bytes} [Mon May 23 10:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609502394 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:55:46.406228 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-450ce3e1-58d4-4507-8556-063b47e39643 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'create', calling method: .version_select at 0x7fe720091430>, body: {"keypair": {"name": "tempest-keypair-1031793595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4ZWeVerBQvydQAbmXM+dudMnsRSnBbivePiU6SwxVMIued3KQtNGKgJL6TEe4ImPwc80lkZxfm7kmI/G5y+UU//GflRrw0h0bki4iyduokl7IjQYAv1rIO6JAyMDclfw=="}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:46.420026 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-450ce3e1-58d4-4507-8556-063b47e39643 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Getting quotas for project 3d45f08040d949bd8949e3d1faab25c4. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:55:46.423992 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-450ce3e1-58d4-4507-8556-063b47e39643 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Getting quotas for user a1fc33c4ee0c4b30a862f6685817bdf4 and project 3d45f08040d949bd8949e3d1faab25c4. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:55:46.446488 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-450ce3e1-58d4-4507-8556-063b47e39643 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044164 May 23 10:55:46.447073 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 260/514] 10.222.0.36 () {60 vars in 1158 bytes} [Mon May 23 10:55:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:47.022513 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d50b4ca2-2270-42b9-8708-6fe12747ce32 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "945a19c9-9199-4d47-8561-68c14a3d7c18"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:47.023657 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d50b4ca2-2270-42b9-8708-6fe12747ce32 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:47.030679 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d50b4ca2-2270-42b9-8708-6fe12747ce32 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:47.031131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d50b4ca2-2270-42b9-8708-6fe12747ce32 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:47.031910 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d50b4ca2-2270-42b9-8708-6fe12747ce32 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:47.032381 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d50b4ca2-2270-42b9-8708-6fe12747ce32 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:47.307693 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d50b4ca2-2270-42b9-8708-6fe12747ce32 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290910 May 23 10:55:47.308477 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 255/515] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:55:47 2022] POST /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:47.715827 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-656906147", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe3ed0a0-128b-4371-b1e9-f319ad129eb5"}], "security_groups": [{"name": "tempest-securitygroup--1481732750"}], "key_name": "tempest-keypair-1031793595", "user_data": "}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:47.815730 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] validate_networks() for [('fe3ed0a0-128b-4371-b1e9-f319ad129eb5', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:55:48.181087 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:55:48.181512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:55:48.182024 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:55:48.182440 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:55:48.182883 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:55:48.191699 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:48.192151 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:48.192952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:48.193395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:48.209700 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Getting quotas for project 3d45f08040d949bd8949e3d1faab25c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:55:48.213661 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Getting quotas for user a1fc33c4ee0c4b30a862f6685817bdf4 and project 3d45f08040d949bd8949e3d1faab25c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:55:48.225133 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:55:48.227387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:55:48.272280 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-0b448e30-7d98-499e-99a8-55e4f4a40e92 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.561145 May 23 10:55:48.272923 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 261/516] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:55:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:55:48.284113 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-70cfe175-783d-4510-90a6-6ca9a47bfba6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:48.284891 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-70cfe175-783d-4510-90a6-6ca9a47bfba6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:48.343787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-70cfe175-783d-4510-90a6-6ca9a47bfba6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:48.351878 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-70cfe175-783d-4510-90a6-6ca9a47bfba6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1237 microversion: 2.1 time: 0.072554 May 23 10:55:48.352533 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 256/517] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:48 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:49.370402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2e5d4be3-8dc6-43ac-b7c7-363172df456b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:49.371018 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2e5d4be3-8dc6-43ac-b7c7-363172df456b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:49.377890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2e5d4be3-8dc6-43ac-b7c7-363172df456b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:49.378376 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2e5d4be3-8dc6-43ac-b7c7-363172df456b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:49.379147 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2e5d4be3-8dc6-43ac-b7c7-363172df456b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:49.379756 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2e5d4be3-8dc6-43ac-b7c7-363172df456b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:49.445428 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2e5d4be3-8dc6-43ac-b7c7-363172df456b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:49.453343 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2e5d4be3-8dc6-43ac-b7c7-363172df456b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1307 microversion: 2.1 time: 0.087322 May 23 10:55:49.454042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 262/518] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:49 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:50.471211 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-50b64c0a-9c5e-4bfe-97a9-69eb066b1615 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:50.472463 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-50b64c0a-9c5e-4bfe-97a9-69eb066b1615 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:50.482075 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-50b64c0a-9c5e-4bfe-97a9-69eb066b1615 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:50.482654 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-50b64c0a-9c5e-4bfe-97a9-69eb066b1615 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:50.483667 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-50b64c0a-9c5e-4bfe-97a9-69eb066b1615 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:50.484452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-50b64c0a-9c5e-4bfe-97a9-69eb066b1615 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:50.687530 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-50b64c0a-9c5e-4bfe-97a9-69eb066b1615 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:50.695620 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-50b64c0a-9c5e-4bfe-97a9-69eb066b1615 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1363 microversion: 2.1 time: 0.228927 May 23 10:55:50.696196 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 257/519] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:50 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:50.756137 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-350e8ed1-3f7d-4c4b-b256-fa54bffc0754 req-960d9f80-9995-43d0-971d-6390ef6595e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c331e053-3f7e-42c9-9f4e-4601f4aa98f9", "tag": "63718413-eeaa-494a-a96d-9c895af0fe1d"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:50.771134 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-350e8ed1-3f7d-4c4b-b256-fa54bffc0754 req-960d9f80-9995-43d0-971d-6390ef6595e7 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:50.772133 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-350e8ed1-3f7d-4c4b-b256-fa54bffc0754 req-960d9f80-9995-43d0-971d-6390ef6595e7 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:50.787919 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-350e8ed1-3f7d-4c4b-b256-fa54bffc0754 req-960d9f80-9995-43d0-971d-6390ef6595e7 service nova] Creating event network-changed:63718413-eeaa-494a-a96d-9c895af0fe1d for instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 on hv-cinder-83699 May 23 10:55:50.793088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-350e8ed1-3f7d-4c4b-b256-fa54bffc0754 req-960d9f80-9995-43d0-971d-6390ef6595e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042172 May 23 10:55:50.793924 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 263/520] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:51.712482 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-18bf2c40-a8fc-48b4-b089-7b5fa6a97fab tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:51.713128 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-18bf2c40-a8fc-48b4-b089-7b5fa6a97fab tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:51.719643 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-18bf2c40-a8fc-48b4-b089-7b5fa6a97fab tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:51.720089 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-18bf2c40-a8fc-48b4-b089-7b5fa6a97fab tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:51.720849 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-18bf2c40-a8fc-48b4-b089-7b5fa6a97fab tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:51.721284 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-18bf2c40-a8fc-48b4-b089-7b5fa6a97fab tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:51.850243 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-18bf2c40-a8fc-48b4-b089-7b5fa6a97fab tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:51.857538 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-18bf2c40-a8fc-48b4-b089-7b5fa6a97fab tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1363 microversion: 2.1 time: 0.148884 May 23 10:55:51.858125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 258/521] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:51 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:52.874431 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-594f35f3-4ea8-434a-99a8-9ce3efbdf40c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:52.875132 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-594f35f3-4ea8-434a-99a8-9ce3efbdf40c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:52.881910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-594f35f3-4ea8-434a-99a8-9ce3efbdf40c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:52.882416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-594f35f3-4ea8-434a-99a8-9ce3efbdf40c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:52.883185 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-594f35f3-4ea8-434a-99a8-9ce3efbdf40c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:52.883625 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-594f35f3-4ea8-434a-99a8-9ce3efbdf40c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:53.013351 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-594f35f3-4ea8-434a-99a8-9ce3efbdf40c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:53.021414 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-594f35f3-4ea8-434a-99a8-9ce3efbdf40c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1363 microversion: 2.1 time: 0.150948 May 23 10:55:53.021996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 264/522] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:52 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:54.038074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-aba2cf07-a3a2-4fea-bfb5-0f2a92a18d3b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:54.038678 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-aba2cf07-a3a2-4fea-bfb5-0f2a92a18d3b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:54.045157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aba2cf07-a3a2-4fea-bfb5-0f2a92a18d3b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:54.045600 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aba2cf07-a3a2-4fea-bfb5-0f2a92a18d3b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:54.046569 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aba2cf07-a3a2-4fea-bfb5-0f2a92a18d3b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:54.047000 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aba2cf07-a3a2-4fea-bfb5-0f2a92a18d3b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:54.176565 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aba2cf07-a3a2-4fea-bfb5-0f2a92a18d3b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:54.184158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-aba2cf07-a3a2-4fea-bfb5-0f2a92a18d3b tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1363 microversion: 2.1 time: 0.149815 May 23 10:55:54.184669 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 259/523] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:54 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:55:54.821285 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-21626d1d-ffaf-4b30-9fba-0f1026ad769a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:54.822252 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-21626d1d-ffaf-4b30-9fba-0f1026ad769a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:54.828646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-21626d1d-ffaf-4b30-9fba-0f1026ad769a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:54.829098 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-21626d1d-ffaf-4b30-9fba-0f1026ad769a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:54.829860 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-21626d1d-ffaf-4b30-9fba-0f1026ad769a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:54.830324 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-21626d1d-ffaf-4b30-9fba-0f1026ad769a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:54.852293 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-21626d1d-ffaf-4b30-9fba-0f1026ad769a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lazy-loading 'flavor' on Instance uuid 67badd04-43b7-41f4-88fc-c7435ac2f158 {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:55:54.971707 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-21626d1d-ffaf-4b30-9fba-0f1026ad769a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/action" status: 200 len: 32 microversion: 2.1 time: 0.154244 May 23 10:55:54.972663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 265/524] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 10:55:54 2022] POST /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/action => generated 32 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 10:55:54.981749 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-627d69c0-701d-4e8e-a1b0-b273dc892673 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:54.982395 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-627d69c0-701d-4e8e-a1b0-b273dc892673 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:54.988525 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-627d69c0-701d-4e8e-a1b0-b273dc892673 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:54.988821 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-627d69c0-701d-4e8e-a1b0-b273dc892673 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:54.989619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-627d69c0-701d-4e8e-a1b0-b273dc892673 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:54.990204 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-627d69c0-701d-4e8e-a1b0-b273dc892673 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:55.201651 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-120b7d20-6e0c-41e6-afcd-cccc9c40e52e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:55.202376 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-120b7d20-6e0c-41e6-afcd-cccc9c40e52e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:55.206789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-627d69c0-701d-4e8e-a1b0-b273dc892673 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:55.209785 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-120b7d20-6e0c-41e6-afcd-cccc9c40e52e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:55.210257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-120b7d20-6e0c-41e6-afcd-cccc9c40e52e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:55.211032 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-120b7d20-6e0c-41e6-afcd-cccc9c40e52e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:55.211653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-120b7d20-6e0c-41e6-afcd-cccc9c40e52e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:55.215971 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-627d69c0-701d-4e8e-a1b0-b273dc892673 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.238025 May 23 10:55:55.216745 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 260/525] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:54 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:55.350174 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-120b7d20-6e0c-41e6-afcd-cccc9c40e52e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:55.357601 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-120b7d20-6e0c-41e6-afcd-cccc9c40e52e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1363 microversion: 2.1 time: 0.160187 May 23 10:55:55.358212 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 266/526] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:55 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:55:56.233869 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-cdd7cff5-c7d4-428e-b251-0b531479c261 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:56.234524 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-cdd7cff5-c7d4-428e-b251-0b531479c261 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:56.241423 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cdd7cff5-c7d4-428e-b251-0b531479c261 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:56.241879 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cdd7cff5-c7d4-428e-b251-0b531479c261 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:56.242689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cdd7cff5-c7d4-428e-b251-0b531479c261 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:56.243131 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cdd7cff5-c7d4-428e-b251-0b531479c261 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:56.252263 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-e66c5f57-fb7d-4630-bb10-d5a1e014ad55 req-bcd837d5-4cc3-4d1d-b30a-3a95804c642d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c331e053-3f7e-42c9-9f4e-4601f4aa98f9", "name": "network-vif-plugged", "status": "completed", "tag": "63718413-eeaa-494a-a96d-9c895af0fe1d"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:56.261402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-e66c5f57-fb7d-4630-bb10-d5a1e014ad55 req-bcd837d5-4cc3-4d1d-b30a-3a95804c642d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:56.262105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-e66c5f57-fb7d-4630-bb10-d5a1e014ad55 req-bcd837d5-4cc3-4d1d-b30a-3a95804c642d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:56.276255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-e66c5f57-fb7d-4630-bb10-d5a1e014ad55 req-bcd837d5-4cc3-4d1d-b30a-3a95804c642d service nova] Creating event network-vif-plugged:63718413-eeaa-494a-a96d-9c895af0fe1d for instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 on hv-cinder-83699 May 23 10:55:56.281255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-e66c5f57-fb7d-4630-bb10-d5a1e014ad55 req-bcd837d5-4cc3-4d1d-b30a-3a95804c642d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034060 May 23 10:55:56.281861 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 267/527] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:55:56.374982 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8e97e7f3-f66b-4cee-a5f2-9155750e6468 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:56.375622 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-8e97e7f3-f66b-4cee-a5f2-9155750e6468 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:56.382405 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8e97e7f3-f66b-4cee-a5f2-9155750e6468 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:56.382859 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8e97e7f3-f66b-4cee-a5f2-9155750e6468 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:56.383630 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8e97e7f3-f66b-4cee-a5f2-9155750e6468 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:56.384057 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-cdd7cff5-c7d4-428e-b251-0b531479c261 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:56.384274 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8e97e7f3-f66b-4cee-a5f2-9155750e6468 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:56.393719 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-cdd7cff5-c7d4-428e-b251-0b531479c261 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.163644 May 23 10:55:56.394346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 261/528] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:56 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:56.526256 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-8e97e7f3-f66b-4cee-a5f2-9155750e6468 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:56.533775 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-8e97e7f3-f66b-4cee-a5f2-9155750e6468 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1363 microversion: 2.1 time: 0.163031 May 23 10:55:56.534380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 268/529] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:56 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:55:57.411141 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9dcf8d95-3ca5-4203-a21f-c843e19c4554 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:57.411744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9dcf8d95-3ca5-4203-a21f-c843e19c4554 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:57.418229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9dcf8d95-3ca5-4203-a21f-c843e19c4554 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:57.418672 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9dcf8d95-3ca5-4203-a21f-c843e19c4554 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:57.419426 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9dcf8d95-3ca5-4203-a21f-c843e19c4554 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:57.419858 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9dcf8d95-3ca5-4203-a21f-c843e19c4554 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:57.549633 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-9dcf8d95-3ca5-4203-a21f-c843e19c4554 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:57.550997 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a404dde1-759a-476f-b1a1-d7eebc99d3e5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:57.551672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a404dde1-759a-476f-b1a1-d7eebc99d3e5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:57.558074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9dcf8d95-3ca5-4203-a21f-c843e19c4554 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.150786 May 23 10:55:57.558564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a404dde1-759a-476f-b1a1-d7eebc99d3e5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:57.558691 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 262/530] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:57 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:57.559015 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a404dde1-759a-476f-b1a1-d7eebc99d3e5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:57.559790 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a404dde1-759a-476f-b1a1-d7eebc99d3e5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:57.560216 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a404dde1-759a-476f-b1a1-d7eebc99d3e5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:57.687298 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a404dde1-759a-476f-b1a1-d7eebc99d3e5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:57.695207 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a404dde1-759a-476f-b1a1-d7eebc99d3e5 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1363 microversion: 2.1 time: 0.148042 May 23 10:55:57.695767 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 269/531] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:57 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:55:58.574968 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6ec089e3-ea1a-4ccc-89fd-0e815fd688d8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:58.575569 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6ec089e3-ea1a-4ccc-89fd-0e815fd688d8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:58.577519 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:58.584200 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ec089e3-ea1a-4ccc-89fd-0e815fd688d8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:58.584644 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ec089e3-ea1a-4ccc-89fd-0e815fd688d8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:58.585402 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ec089e3-ea1a-4ccc-89fd-0e815fd688d8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:58.585834 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6ec089e3-ea1a-4ccc-89fd-0e815fd688d8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:58.711575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6ec089e3-ea1a-4ccc-89fd-0e815fd688d8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:58.711745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d0d5735f-132d-435e-a3dc-48f0cfad7c96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:58.712263 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d0d5735f-132d-435e-a3dc-48f0cfad7c96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:58.714340 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:58.715190 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=10 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:55:58.719734 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6ec089e3-ea1a-4ccc-89fd-0e815fd688d8 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.148584 May 23 10:55:58.720315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 263/532] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:58 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:55:58.721725 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d0d5735f-132d-435e-a3dc-48f0cfad7c96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:58.722218 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d0d5735f-132d-435e-a3dc-48f0cfad7c96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:58.723002 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d0d5735f-132d-435e-a3dc-48f0cfad7c96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:58.723444 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d0d5735f-132d-435e-a3dc-48f0cfad7c96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:58.853387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d0d5735f-132d-435e-a3dc-48f0cfad7c96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:58.860836 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d0d5735f-132d-435e-a3dc-48f0cfad7c96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1550 microversion: 2.1 time: 0.153023 May 23 10:55:58.861405 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 270/533] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:58 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:55:58.877327 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-52fcbb9c-0188-4a23-ab74-2f86cf75c383 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:58.877814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-52fcbb9c-0188-4a23-ab74-2f86cf75c383 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:58.884452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-52fcbb9c-0188-4a23-ab74-2f86cf75c383 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:58.884900 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-52fcbb9c-0188-4a23-ab74-2f86cf75c383 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:58.885661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-52fcbb9c-0188-4a23-ab74-2f86cf75c383 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:58.886132 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-52fcbb9c-0188-4a23-ab74-2f86cf75c383 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:58.963057 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-52fcbb9c-0188-4a23-ab74-2f86cf75c383 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089453 May 23 10:55:58.963637 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 264/534] 10.222.0.36 () {58 vars in 1274 bytes} [Mon May 23 10:55:58 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:55:59.738117 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1c8d9cf4-e970-4d76-8f18-9a94c94b335e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:55:59.739065 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1c8d9cf4-e970-4d76-8f18-9a94c94b335e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:55:59.746931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1c8d9cf4-e970-4d76-8f18-9a94c94b335e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:59.747431 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1c8d9cf4-e970-4d76-8f18-9a94c94b335e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:59.748215 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1c8d9cf4-e970-4d76-8f18-9a94c94b335e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:59.748654 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1c8d9cf4-e970-4d76-8f18-9a94c94b335e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:59.853589 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-87004a3b-303b-4045-ae19-8d29414fb128 req-21c748d3-b79f-4735-ba9c-0160e4079406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c331e053-3f7e-42c9-9f4e-4601f4aa98f9", "tag": "63718413-eeaa-494a-a96d-9c895af0fe1d"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:55:59.862974 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-87004a3b-303b-4045-ae19-8d29414fb128 req-21c748d3-b79f-4735-ba9c-0160e4079406 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:55:59.863425 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-87004a3b-303b-4045-ae19-8d29414fb128 req-21c748d3-b79f-4735-ba9c-0160e4079406 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:55:59.875694 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-87004a3b-303b-4045-ae19-8d29414fb128 req-21c748d3-b79f-4735-ba9c-0160e4079406 service nova] Creating event network-changed:63718413-eeaa-494a-a96d-9c895af0fe1d for instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 on hv-cinder-83699 May 23 10:55:59.881181 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-87004a3b-303b-4045-ae19-8d29414fb128 req-21c748d3-b79f-4735-ba9c-0160e4079406 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033175 May 23 10:55:59.881702 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 265/535] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:55:59.884325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1c8d9cf4-e970-4d76-8f18-9a94c94b335e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:55:59.892258 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1c8d9cf4-e970-4d76-8f18-9a94c94b335e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.158273 May 23 10:55:59.892826 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 271/536] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:55:59 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:00.604384 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1378f12c-5b63-4af8-95d2-e56c9e5c03dc tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:00.605188 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1378f12c-5b63-4af8-95d2-e56c9e5c03dc tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:00.611850 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1378f12c-5b63-4af8-95d2-e56c9e5c03dc tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:00.612296 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1378f12c-5b63-4af8-95d2-e56c9e5c03dc tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:00.613071 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1378f12c-5b63-4af8-95d2-e56c9e5c03dc tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:00.613510 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1378f12c-5b63-4af8-95d2-e56c9e5c03dc tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:00.637031 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1378f12c-5b63-4af8-95d2-e56c9e5c03dc tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/ips" status: 200 len: 148 microversion: 2.1 time: 0.036881 May 23 10:56:00.637618 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 266/537] 10.222.0.36 () {58 vars in 1247 bytes} [Mon May 23 10:56:00 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:00.910401 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4014461b-a54e-4484-b47e-6ce728d3cb6b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:00.911007 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-4014461b-a54e-4484-b47e-6ce728d3cb6b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:00.917845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4014461b-a54e-4484-b47e-6ce728d3cb6b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:00.918317 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4014461b-a54e-4484-b47e-6ce728d3cb6b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:00.919076 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4014461b-a54e-4484-b47e-6ce728d3cb6b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:00.919510 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4014461b-a54e-4484-b47e-6ce728d3cb6b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:00.922113 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:01.050203 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-4014461b-a54e-4484-b47e-6ce728d3cb6b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:01.057986 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4014461b-a54e-4484-b47e-6ce728d3cb6b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.151511 May 23 10:56:01.058538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 272/538] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:00 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:01.968057 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6a10bc20-bf9a-4183-9e39-b058d3d57c38 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc6fdb28-a510-43e1-bd62-8e29fb9bc05f"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:01.969153 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6a10bc20-bf9a-4183-9e39-b058d3d57c38 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:01.975689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6a10bc20-bf9a-4183-9e39-b058d3d57c38 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:01.976139 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6a10bc20-bf9a-4183-9e39-b058d3d57c38 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:01.976906 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6a10bc20-bf9a-4183-9e39-b058d3d57c38 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:01.977340 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6a10bc20-bf9a-4183-9e39-b058d3d57c38 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:02.074747 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8e364be5-5c24-4633-8cd6-7c07fc91b5bd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:02.075360 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-8e364be5-5c24-4633-8cd6-7c07fc91b5bd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:02.082135 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8e364be5-5c24-4633-8cd6-7c07fc91b5bd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:02.082871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8e364be5-5c24-4633-8cd6-7c07fc91b5bd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:02.083779 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8e364be5-5c24-4633-8cd6-7c07fc91b5bd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:02.084217 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8e364be5-5c24-4633-8cd6-7c07fc91b5bd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:02.220800 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-8e364be5-5c24-4633-8cd6-7c07fc91b5bd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:02.228586 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:02.240705 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-8e364be5-5c24-4633-8cd6-7c07fc91b5bd tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.169618 May 23 10:56:02.241696 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 273/539] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:02 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:56:02.250779 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6a10bc20-bf9a-4183-9e39-b058d3d57c38 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286481 May 23 10:56:02.251601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 267/540] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:56:01 2022] POST /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:03.258237 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-521bd1f2-0186-49f3-ad2f-963b79886539 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:03.258842 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-521bd1f2-0186-49f3-ad2f-963b79886539 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:03.265232 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-521bd1f2-0186-49f3-ad2f-963b79886539 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:03.265676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-521bd1f2-0186-49f3-ad2f-963b79886539 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:03.266450 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-521bd1f2-0186-49f3-ad2f-963b79886539 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:03.266880 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-521bd1f2-0186-49f3-ad2f-963b79886539 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:03.400425 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-521bd1f2-0186-49f3-ad2f-963b79886539 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:03.408306 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-521bd1f2-0186-49f3-ad2f-963b79886539 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.154518 May 23 10:56:03.408871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 274/541] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:03 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:04.425439 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0252f888-6437-4d4e-9942-b0308b8007ce tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:04.426468 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0252f888-6437-4d4e-9942-b0308b8007ce tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:04.432617 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0252f888-6437-4d4e-9942-b0308b8007ce tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:04.433068 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0252f888-6437-4d4e-9942-b0308b8007ce tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:04.433831 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0252f888-6437-4d4e-9942-b0308b8007ce tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:04.434293 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0252f888-6437-4d4e-9942-b0308b8007ce tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:04.560493 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0252f888-6437-4d4e-9942-b0308b8007ce tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:04.568858 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0252f888-6437-4d4e-9942-b0308b8007ce tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.148107 May 23 10:56:04.569426 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 268/542] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:04 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:05.585633 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f7160927-d9a9-40d3-8007-7b40ad81db65 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:05.586269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f7160927-d9a9-40d3-8007-7b40ad81db65 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:05.592795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f7160927-d9a9-40d3-8007-7b40ad81db65 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:05.593250 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f7160927-d9a9-40d3-8007-7b40ad81db65 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:05.594043 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f7160927-d9a9-40d3-8007-7b40ad81db65 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:05.594487 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f7160927-d9a9-40d3-8007-7b40ad81db65 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:05.724698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f7160927-d9a9-40d3-8007-7b40ad81db65 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:05.732625 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f7160927-d9a9-40d3-8007-7b40ad81db65 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.151462 May 23 10:56:05.733197 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 275/543] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:05 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:06.749591 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c8f78492-54e6-408d-955b-524a27985815 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:06.750172 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c8f78492-54e6-408d-955b-524a27985815 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:06.757133 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c8f78492-54e6-408d-955b-524a27985815 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:06.757576 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c8f78492-54e6-408d-955b-524a27985815 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:06.758365 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c8f78492-54e6-408d-955b-524a27985815 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:06.758793 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c8f78492-54e6-408d-955b-524a27985815 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:06.882544 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c8f78492-54e6-408d-955b-524a27985815 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:06.890345 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c8f78492-54e6-408d-955b-524a27985815 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.144582 May 23 10:56:06.890916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 269/544] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:06 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:07.908198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-047675c6-c5e7-4f6a-80ce-21de6f895150 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:07.908800 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-047675c6-c5e7-4f6a-80ce-21de6f895150 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:07.915773 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-047675c6-c5e7-4f6a-80ce-21de6f895150 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:07.916216 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-047675c6-c5e7-4f6a-80ce-21de6f895150 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:07.916967 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-047675c6-c5e7-4f6a-80ce-21de6f895150 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:07.917395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-047675c6-c5e7-4f6a-80ce-21de6f895150 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:08.042115 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-047675c6-c5e7-4f6a-80ce-21de6f895150 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:08.049870 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-047675c6-c5e7-4f6a-80ce-21de6f895150 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1735 microversion: 2.1 time: 0.145530 May 23 10:56:08.050464 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 276/545] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:07 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:09.068699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a63f3b83-538e-4140-a8b7-314a0fe678df tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:09.069481 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a63f3b83-538e-4140-a8b7-314a0fe678df tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:09.076759 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a63f3b83-538e-4140-a8b7-314a0fe678df tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:09.077199 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a63f3b83-538e-4140-a8b7-314a0fe678df tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:09.077967 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a63f3b83-538e-4140-a8b7-314a0fe678df tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:09.078402 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a63f3b83-538e-4140-a8b7-314a0fe678df tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:09.203745 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a63f3b83-538e-4140-a8b7-314a0fe678df tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:09.211553 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a63f3b83-538e-4140-a8b7-314a0fe678df tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1715 microversion: 2.1 time: 0.148202 May 23 10:56:09.212116 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 270/546] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:09 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:09.265712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a11806cb-5551-41fb-9779-d1908209b553 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:09.266269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a11806cb-5551-41fb-9779-d1908209b553 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:09.272911 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a11806cb-5551-41fb-9779-d1908209b553 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:09.273373 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a11806cb-5551-41fb-9779-d1908209b553 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:09.274168 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a11806cb-5551-41fb-9779-d1908209b553 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:09.274602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a11806cb-5551-41fb-9779-d1908209b553 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:09.355902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-a11806cb-5551-41fb-9779-d1908209b553 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] HTTP exception thrown: Cannot 'detach_volume' instance 67badd04-43b7-41f4-88fc-c7435ac2f158 while it is in vm_state rescued May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a11806cb-5551-41fb-9779-d1908209b553 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Request method failure captured: May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments/945a19c9-9199-4d47-8561-68c14a3d7c18 HTTP/1.1 May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2eLhnLJl1WQHI6AQhbejgYPFTmHkdxSbb8YGQPU-jfMtBrmgOgTu6SnJpnxYF42UIG9Y970L_Xtfbn7Z694Bj4Sxalc3YSV73HRTz_zeRlmCwMmhl_7B5-C6bxvl_9ZZJTQqwCn8HXEekRlTd41SnLC_JFnHqfCQzK0qmyt8KWdAzI May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 33781de828264846b90b5cbbbeee7fe5 May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:56:09.357520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33781de828264846b90b5cbbbeee7fe5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 33781de828264846b90b5cbbbeee7fe5 May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-ServerRescueNegativeTestJSON-485230613-project May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 06f644c1c44d4dafacbd5bbdde323ff0 May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-ServerRescueNegativeTestJSON-485230613-project May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:56:09.359125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Cannot 'detach_volume' instance 67badd04-43b7-41f4-88fc-c7435ac2f158 while it is in vm_state rescued May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'server_id': '67badd04-43b7-41f4-88fc-c7435ac2f158', 'id': '945a19c9-9199-4d47-8561-68c14a3d7c18'} May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 67badd04-43b7-41f4-88fc-c7435ac2f158 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:56:09.359996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 67badd04-43b7-41f4-88fc-c7435ac2f158 while it is in vm_state rescued May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 67badd04-43b7-41f4-88fc-c7435ac2f158 while it is in vm_state rescued May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:56:09.361646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a11806cb-5551-41fb-9779-d1908209b553 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Returning 409 to user: Cannot 'detach_volume' instance 67badd04-43b7-41f4-88fc-c7435ac2f158 while it is in vm_state rescued {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:56:09.362909 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a11806cb-5551-41fb-9779-d1908209b553 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments/945a19c9-9199-4d47-8561-68c14a3d7c18" status: 409 len: 152 microversion: 2.1 time: 0.097170 May 23 10:56:09.362909 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 277/547] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 10:56:09 2022] DELETE /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments/945a19c9-9199-4d47-8561-68c14a3d7c18 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 10:56:09.368498 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bfd9aab4-9798-4ccd-a8e6-667b5768ef0f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:09.369028 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-bfd9aab4-9798-4ccd-a8e6-667b5768ef0f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:09.375010 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bfd9aab4-9798-4ccd-a8e6-667b5768ef0f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:09.375450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bfd9aab4-9798-4ccd-a8e6-667b5768ef0f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:09.376204 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bfd9aab4-9798-4ccd-a8e6-667b5768ef0f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:09.376635 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bfd9aab4-9798-4ccd-a8e6-667b5768ef0f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:09.439667 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-bfd9aab4-9798-4ccd-a8e6-667b5768ef0f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "POST /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/action" status: 202 len: 0 microversion: 2.1 time: 0.075409 May 23 10:56:09.440290 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 271/548] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 10:56:09 2022] POST /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 10:56:09.448981 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-23ca4ec3-1f3b-457d-82b4-2af40f86c171 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:09.449596 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-23ca4ec3-1f3b-457d-82b4-2af40f86c171 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:09.455665 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-23ca4ec3-1f3b-457d-82b4-2af40f86c171 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:09.456121 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-23ca4ec3-1f3b-457d-82b4-2af40f86c171 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:09.456883 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-23ca4ec3-1f3b-457d-82b4-2af40f86c171 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:09.457323 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-23ca4ec3-1f3b-457d-82b4-2af40f86c171 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:09.583232 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-23ca4ec3-1f3b-457d-82b4-2af40f86c171 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:09.591166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-23ca4ec3-1f3b-457d-82b4-2af40f86c171 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1723 microversion: 2.1 time: 0.145961 May 23 10:56:09.591727 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 278/549] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:09 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:10.609528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-930fd71a-b051-4487-b8ee-a0e11bb5bc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:10.610262 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-930fd71a-b051-4487-b8ee-a0e11bb5bc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:10.617094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-930fd71a-b051-4487-b8ee-a0e11bb5bc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:10.617531 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-930fd71a-b051-4487-b8ee-a0e11bb5bc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:10.618333 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-930fd71a-b051-4487-b8ee-a0e11bb5bc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:10.618779 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-930fd71a-b051-4487-b8ee-a0e11bb5bc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:10.749456 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-930fd71a-b051-4487-b8ee-a0e11bb5bc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:10.758144 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-930fd71a-b051-4487-b8ee-a0e11bb5bc05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1723 microversion: 2.1 time: 0.153321 May 23 10:56:10.758719 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 272/550] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:10 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:10.797584 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-7ca1d0dc-3933-4b4d-8841-add68f72e313 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc6fdb28-a510-43e1-bd62-8e29fb9bc05f"}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:10.798739 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-7ca1d0dc-3933-4b4d-8841-add68f72e313 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:10.805108 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7ca1d0dc-3933-4b4d-8841-add68f72e313 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:10.805588 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7ca1d0dc-3933-4b4d-8841-add68f72e313 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:10.806405 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7ca1d0dc-3933-4b4d-8841-add68f72e313 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:10.806841 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7ca1d0dc-3933-4b4d-8841-add68f72e313 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:10.884227 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-7ca1d0dc-3933-4b4d-8841-add68f72e313 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Invalid volume: volume dc6fdb28-a510-43e1-bd62-8e29fb9bc05f is already attached to instances: e34bc626-48f7-41fe-9f92-2581c01532d9 May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-7ca1d0dc-3933-4b4d-8841-add68f72e313 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: POST /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments HTTP/1.1 May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 74 May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:56:10.885871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {"volumeAttachment": {"volumeId": "dc6fdb28-a510-43e1-bd62-8e29fb9bc05f"}} May 23 10:56:10.887416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Invalid volume: volume dc6fdb28-a510-43e1-bd62-8e29fb9bc05f is already attached to instances: e34bc626-48f7-41fe-9f92-2581c01532d9 May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'server_id': 'e34bc626-48f7-41fe-9f92-2581c01532d9', 'body': {'volumeAttachment': {'volumeId': 'dc6fdb28-a510-43e1-bd62-8e29fb9bc05f'}}} May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dc6fdb28-a510-43e1-bd62-8e29fb9bc05f is already attached to instances: e34bc626-48f7-41fe-9f92-2581c01532d9 May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:56:10.888224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dc6fdb28-a510-43e1-bd62-8e29fb9bc05f is already attached to instances: e34bc626-48f7-41fe-9f92-2581c01532d9 May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:56:10.889322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:56:10.890509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:56:10.890509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:56:10.890509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:56:10.890509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dc6fdb28-a510-43e1-bd62-8e29fb9bc05f is already attached to instances: e34bc626-48f7-41fe-9f92-2581c01532d9 May 23 10:56:10.890509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:56:10.890509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-7ca1d0dc-3933-4b4d-8841-add68f72e313 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 400 to user: Invalid volume: volume dc6fdb28-a510-43e1-bd62-8e29fb9bc05f is already attached to instances: e34bc626-48f7-41fe-9f92-2581c01532d9 {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:56:10.890509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-7ca1d0dc-3933-4b4d-8841-add68f72e313 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093713 May 23 10:56:10.890509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 279/551] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:56:10 2022] POST /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 10:56:10.950921 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ecf0c170-af31-425f-b862-e8650f832747 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:10.951386 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ecf0c170-af31-425f-b862-e8650f832747 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:10.953315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:10.959160 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ecf0c170-af31-425f-b862-e8650f832747 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:10.959614 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ecf0c170-af31-425f-b862-e8650f832747 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:10.960388 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ecf0c170-af31-425f-b862-e8650f832747 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:10.960830 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ecf0c170-af31-425f-b862-e8650f832747 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:11.039165 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-ecf0c170-af31-425f-b862-e8650f832747 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lazy-loading 'services' on Instance uuid e34bc626-48f7-41fe-9f92-2581c01532d9 {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:56:11.109050 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ecf0c170-af31-425f-b862-e8650f832747 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments/dc6fdb28-a510-43e1-bd62-8e29fb9bc05f" status: 202 len: 0 microversion: 2.1 time: 0.161975 May 23 10:56:11.109629 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 273/552] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 10:56:10 2022] DELETE /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments/dc6fdb28-a510-43e1-bd62-8e29fb9bc05f => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:56:11.117920 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e0dacc57-dd11-4a57-b7f3-357ec229b7d0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:11.118854 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e0dacc57-dd11-4a57-b7f3-357ec229b7d0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:11.120710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:11.126914 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e0dacc57-dd11-4a57-b7f3-357ec229b7d0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:11.127368 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e0dacc57-dd11-4a57-b7f3-357ec229b7d0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:11.128131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e0dacc57-dd11-4a57-b7f3-357ec229b7d0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:11.128569 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e0dacc57-dd11-4a57-b7f3-357ec229b7d0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:11.158893 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e0dacc57-dd11-4a57-b7f3-357ec229b7d0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045005 May 23 10:56:11.159436 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 280/553] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:56:11 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:11.776543 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1dc77abe-89b3-42f1-8dfb-bbd19c4baa0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:11.777244 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1dc77abe-89b3-42f1-8dfb-bbd19c4baa0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:11.786949 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1dc77abe-89b3-42f1-8dfb-bbd19c4baa0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:11.787431 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1dc77abe-89b3-42f1-8dfb-bbd19c4baa0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:11.788300 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1dc77abe-89b3-42f1-8dfb-bbd19c4baa0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:11.788744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1dc77abe-89b3-42f1-8dfb-bbd19c4baa0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:11.914788 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1dc77abe-89b3-42f1-8dfb-bbd19c4baa0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:11.922725 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1dc77abe-89b3-42f1-8dfb-bbd19c4baa0b tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1723 microversion: 2.1 time: 0.150841 May 23 10:56:11.923302 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 274/554] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:11 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:12.171494 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ec30ea28-9c83-4463-ba7f-d55342a9ab7e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:12.172420 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ec30ea28-9c83-4463-ba7f-d55342a9ab7e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:12.179456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ec30ea28-9c83-4463-ba7f-d55342a9ab7e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:12.179911 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ec30ea28-9c83-4463-ba7f-d55342a9ab7e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:12.180681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ec30ea28-9c83-4463-ba7f-d55342a9ab7e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:12.181155 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ec30ea28-9c83-4463-ba7f-d55342a9ab7e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:12.208862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ec30ea28-9c83-4463-ba7f-d55342a9ab7e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041289 May 23 10:56:12.209406 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 281/555] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:56:12 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:12.939490 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d6812c80-a838-49cb-84cc-4b6c938b5796 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:12.940130 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d6812c80-a838-49cb-84cc-4b6c938b5796 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:12.947205 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d6812c80-a838-49cb-84cc-4b6c938b5796 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:12.947652 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d6812c80-a838-49cb-84cc-4b6c938b5796 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:12.948425 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d6812c80-a838-49cb-84cc-4b6c938b5796 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:12.948857 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d6812c80-a838-49cb-84cc-4b6c938b5796 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:13.075802 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d6812c80-a838-49cb-84cc-4b6c938b5796 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:13.084236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d6812c80-a838-49cb-84cc-4b6c938b5796 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1729 microversion: 2.1 time: 0.148626 May 23 10:56:13.084799 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 275/556] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:12 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:13.100889 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cec05da0-b12a-4692-8f26-29822face735 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:13.101376 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-cec05da0-b12a-4692-8f26-29822face735 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:13.107248 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cec05da0-b12a-4692-8f26-29822face735 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:13.107692 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cec05da0-b12a-4692-8f26-29822face735 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:13.108471 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cec05da0-b12a-4692-8f26-29822face735 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:13.108902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cec05da0-b12a-4692-8f26-29822face735 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:13.188937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-cec05da0-b12a-4692-8f26-29822face735 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092422 May 23 10:56:13.189553 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 282/557] 10.222.0.36 () {58 vars in 1274 bytes} [Mon May 23 10:56:13 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:56:13.220552 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-efa1be7a-fa75-48ca-87cd-7bbc470a65a7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:13.221112 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-efa1be7a-fa75-48ca-87cd-7bbc470a65a7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:13.227927 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-efa1be7a-fa75-48ca-87cd-7bbc470a65a7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:13.228451 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-efa1be7a-fa75-48ca-87cd-7bbc470a65a7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:13.229265 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-efa1be7a-fa75-48ca-87cd-7bbc470a65a7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:13.229681 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-efa1be7a-fa75-48ca-87cd-7bbc470a65a7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:13.259740 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-efa1be7a-fa75-48ca-87cd-7bbc470a65a7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043420 May 23 10:56:13.260314 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 276/558] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:56:13 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:14.051629 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-3ba1cba1-0cdc-40a2-800d-d18905df7e8d req-1f0f3380-afad-4e06-afd9-eac6a8ad6aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67badd04-43b7-41f4-88fc-c7435ac2f158", "tag": "9da49a79-8d41-4702-8f35-b66bc046212c"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:14.059867 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-3ba1cba1-0cdc-40a2-800d-d18905df7e8d req-1f0f3380-afad-4e06-afd9-eac6a8ad6aba service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:14.060460 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-3ba1cba1-0cdc-40a2-800d-d18905df7e8d req-1f0f3380-afad-4e06-afd9-eac6a8ad6aba service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:14.073682 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-3ba1cba1-0cdc-40a2-800d-d18905df7e8d req-1f0f3380-afad-4e06-afd9-eac6a8ad6aba service nova] Creating event network-changed:9da49a79-8d41-4702-8f35-b66bc046212c for instance 67badd04-43b7-41f4-88fc-c7435ac2f158 on hv-cinder-83699 May 23 10:56:14.079103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-3ba1cba1-0cdc-40a2-800d-d18905df7e8d req-1f0f3380-afad-4e06-afd9-eac6a8ad6aba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031158 May 23 10:56:14.079846 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 283/559] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:14.272262 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-511fbc78-6902-4d63-aad9-4bda6c853478 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:14.273193 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-511fbc78-6902-4d63-aad9-4bda6c853478 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:14.285321 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-511fbc78-6902-4d63-aad9-4bda6c853478 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:14.286196 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-511fbc78-6902-4d63-aad9-4bda6c853478 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:14.287187 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-511fbc78-6902-4d63-aad9-4bda6c853478 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:14.287805 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-511fbc78-6902-4d63-aad9-4bda6c853478 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:14.319442 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-511fbc78-6902-4d63-aad9-4bda6c853478 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051977 May 23 10:56:14.320624 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 277/560] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:56:14 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 10:56:14.382562 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c2e3beea-95b3-4dbd-ad2d-5fcae89c1aaf tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:14.383090 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c2e3beea-95b3-4dbd-ad2d-5fcae89c1aaf tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:14.389278 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c2e3beea-95b3-4dbd-ad2d-5fcae89c1aaf tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:14.389727 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c2e3beea-95b3-4dbd-ad2d-5fcae89c1aaf tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:14.390526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c2e3beea-95b3-4dbd-ad2d-5fcae89c1aaf tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:14.390969 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c2e3beea-95b3-4dbd-ad2d-5fcae89c1aaf tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:14.418753 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c2e3beea-95b3-4dbd-ad2d-5fcae89c1aaf tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:56:14.505245 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c2e3beea-95b3-4dbd-ad2d-5fcae89c1aaf tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 204 len: 0 microversion: 2.1 time: 0.126570 May 23 10:56:14.506698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 284/561] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:56:14 2022] DELETE /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 10:56:14.514554 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-14d15064-000d-4910-97d4-ae4ee1dc0842 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:14.515254 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-14d15064-000d-4910-97d4-ae4ee1dc0842 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:14.522876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-14d15064-000d-4910-97d4-ae4ee1dc0842 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:14.523409 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-14d15064-000d-4910-97d4-ae4ee1dc0842 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:14.524410 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-14d15064-000d-4910-97d4-ae4ee1dc0842 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:14.524913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-14d15064-000d-4910-97d4-ae4ee1dc0842 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:14.658826 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-14d15064-000d-4910-97d4-ae4ee1dc0842 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:14.666732 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-14d15064-000d-4910-97d4-ae4ee1dc0842 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1680 microversion: 2.1 time: 0.155892 May 23 10:56:14.667324 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 278/562] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:14 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:56:14.969885 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c9879380-f58c-41c1-b832-d2569f5cf6e2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:14.970499 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c9879380-f58c-41c1-b832-d2569f5cf6e2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:14.977074 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c9879380-f58c-41c1-b832-d2569f5cf6e2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:14.977541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c9879380-f58c-41c1-b832-d2569f5cf6e2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:14.978352 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c9879380-f58c-41c1-b832-d2569f5cf6e2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:14.978793 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c9879380-f58c-41c1-b832-d2569f5cf6e2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:15.000751 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c9879380-f58c-41c1-b832-d2569f5cf6e2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/ips" status: 200 len: 152 microversion: 2.20 time: 0.035114 May 23 10:56:15.001317 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 285/563] 10.222.0.36 () {60 vars in 1288 bytes} [Mon May 23 10:56:14 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:56:15.683873 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-789b4bbf-0d70-4c80-8911-be42cfbf565d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:15.684488 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-789b4bbf-0d70-4c80-8911-be42cfbf565d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:15.691135 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-789b4bbf-0d70-4c80-8911-be42cfbf565d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:15.691583 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-789b4bbf-0d70-4c80-8911-be42cfbf565d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:15.692986 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-789b4bbf-0d70-4c80-8911-be42cfbf565d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:15.693447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-789b4bbf-0d70-4c80-8911-be42cfbf565d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:15.823705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-789b4bbf-0d70-4c80-8911-be42cfbf565d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:15.831117 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-789b4bbf-0d70-4c80-8911-be42cfbf565d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1680 microversion: 2.1 time: 0.151089 May 23 10:56:15.831682 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 279/564] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:15 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:16.093076 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-82eca235-936f-4e71-9a96-62c401b9e483 req-83d32a86-59d7-4695-be90-5d139c0c1b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67badd04-43b7-41f4-88fc-c7435ac2f158", "tag": "9da49a79-8d41-4702-8f35-b66bc046212c"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:16.101555 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-82eca235-936f-4e71-9a96-62c401b9e483 req-83d32a86-59d7-4695-be90-5d139c0c1b6e service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:16.102022 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-82eca235-936f-4e71-9a96-62c401b9e483 req-83d32a86-59d7-4695-be90-5d139c0c1b6e service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:16.112815 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-82eca235-936f-4e71-9a96-62c401b9e483 req-83d32a86-59d7-4695-be90-5d139c0c1b6e service nova] Creating event network-changed:9da49a79-8d41-4702-8f35-b66bc046212c for instance 67badd04-43b7-41f4-88fc-c7435ac2f158 on hv-cinder-83699 May 23 10:56:16.117926 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-82eca235-936f-4e71-9a96-62c401b9e483 req-83d32a86-59d7-4695-be90-5d139c0c1b6e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028467 May 23 10:56:16.118531 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 286/565] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:16.848949 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-440cd2c1-9deb-485b-b9bb-42ef21f7d050 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:16.850235 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-440cd2c1-9deb-485b-b9bb-42ef21f7d050 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:16.856725 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-440cd2c1-9deb-485b-b9bb-42ef21f7d050 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:16.857179 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-440cd2c1-9deb-485b-b9bb-42ef21f7d050 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:16.857983 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-440cd2c1-9deb-485b-b9bb-42ef21f7d050 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:16.858851 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-440cd2c1-9deb-485b-b9bb-42ef21f7d050 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:17.074937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ac43fd2c-d372-498c-beff-d64addf5095e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:17.075566 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ac43fd2c-d372-498c-beff-d64addf5095e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:17.081781 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ac43fd2c-d372-498c-beff-d64addf5095e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:17.082260 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ac43fd2c-d372-498c-beff-d64addf5095e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:17.083641 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ac43fd2c-d372-498c-beff-d64addf5095e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:17.084082 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ac43fd2c-d372-498c-beff-d64addf5095e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:17.107177 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-ac43fd2c-d372-498c-beff-d64addf5095e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lazy-loading 'flavor' on Instance uuid bde224c6-c41a-4424-8bc4-bd8f62d9fa53 {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:56:17.153556 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-440cd2c1-9deb-485b-b9bb-42ef21f7d050 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:17.155392 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:17.163268 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-440cd2c1-9deb-485b-b9bb-42ef21f7d050 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1680 microversion: 2.1 time: 0.318923 May 23 10:56:17.164099 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 280/566] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:16 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1680 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:17.376393 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ac43fd2c-d372-498c-beff-d64addf5095e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "POST /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/action" status: 202 len: 0 microversion: 2.20 time: 0.305665 May 23 10:56:17.377478 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 287/567] 10.222.0.36 () {62 vars in 1318 bytes} [Mon May 23 10:56:17 2022] POST /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 10:56:17.386473 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1e091deb-65ee-4f44-8215-06f2013b27cf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:17.387080 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1e091deb-65ee-4f44-8215-06f2013b27cf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:17.394592 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1e091deb-65ee-4f44-8215-06f2013b27cf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:17.396023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1e091deb-65ee-4f44-8215-06f2013b27cf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:17.397007 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1e091deb-65ee-4f44-8215-06f2013b27cf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:17.397724 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1e091deb-65ee-4f44-8215-06f2013b27cf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:17.600192 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1e091deb-65ee-4f44-8215-06f2013b27cf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:17.608186 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1e091deb-65ee-4f44-8215-06f2013b27cf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:17.609730 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1e091deb-65ee-4f44-8215-06f2013b27cf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:17.610880 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1e091deb-65ee-4f44-8215-06f2013b27cf tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.228486 May 23 10:56:17.611453 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 281/568] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:17 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:17.710256 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-bb0e7b74-48ed-438a-a528-151f728ea774 req-e49ab202-b3e6-4d12-84c4-00494c6e5255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34bc626-48f7-41fe-9f92-2581c01532d9", "name": "network-vif-deleted", "tag": "e5cbde79-dd3a-41b0-a7ff-4c188bf495b5"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:17.719188 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-bb0e7b74-48ed-438a-a528-151f728ea774 req-e49ab202-b3e6-4d12-84c4-00494c6e5255 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:17.719615 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-bb0e7b74-48ed-438a-a528-151f728ea774 req-e49ab202-b3e6-4d12-84c4-00494c6e5255 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:17.734598 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-bb0e7b74-48ed-438a-a528-151f728ea774 req-e49ab202-b3e6-4d12-84c4-00494c6e5255 service nova] Creating event network-vif-deleted:e5cbde79-dd3a-41b0-a7ff-4c188bf495b5 for instance e34bc626-48f7-41fe-9f92-2581c01532d9 on hv-cinder-83699 May 23 10:56:17.740143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-bb0e7b74-48ed-438a-a528-151f728ea774 req-e49ab202-b3e6-4d12-84c4-00494c6e5255 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034422 May 23 10:56:17.741011 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 288/569] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:18.180811 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:18.181445 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:18.187929 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:18.188380 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:18.189143 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:18.189578 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:18.194196 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:18.224735 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:18.225192 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:18.225729 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lazy-loading 'fault' on Instance uuid e34bc626-48f7-41fe-9f92-2581c01532d9 {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:56:18.273405 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:18.281697 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4a8acb56-a492-455b-96aa-78603d46fcef tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 200 len: 1331 microversion: 2.1 time: 0.104903 May 23 10:56:18.282304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 282/570] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:18 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:18.629435 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c66f7b21-61a8-4b11-961f-7bb49771cb3b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:18.630182 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c66f7b21-61a8-4b11-961f-7bb49771cb3b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:18.636809 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c66f7b21-61a8-4b11-961f-7bb49771cb3b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:18.637258 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c66f7b21-61a8-4b11-961f-7bb49771cb3b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:18.638051 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c66f7b21-61a8-4b11-961f-7bb49771cb3b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:18.638491 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c66f7b21-61a8-4b11-961f-7bb49771cb3b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:18.768041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c66f7b21-61a8-4b11-961f-7bb49771cb3b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:18.776646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c66f7b21-61a8-4b11-961f-7bb49771cb3b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:18.778152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c66f7b21-61a8-4b11-961f-7bb49771cb3b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:18.779294 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c66f7b21-61a8-4b11-961f-7bb49771cb3b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.154128 May 23 10:56:18.779851 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 289/571] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:18 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:19.299107 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0bdf18fa-6939-49a4-aa9d-0d5f2b365a56 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:19.299713 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0bdf18fa-6939-49a4-aa9d-0d5f2b365a56 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:19.306200 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0bdf18fa-6939-49a4-aa9d-0d5f2b365a56 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:19.306648 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0bdf18fa-6939-49a4-aa9d-0d5f2b365a56 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:19.307399 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0bdf18fa-6939-49a4-aa9d-0d5f2b365a56 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:19.307828 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0bdf18fa-6939-49a4-aa9d-0d5f2b365a56 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:19.322381 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-0bdf18fa-6939-49a4-aa9d-0d5f2b365a56 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0bdf18fa-6939-49a4-aa9d-0d5f2b365a56 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 HTTP/1.1 May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:56:19.323990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:56:19.325370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'e34bc626-48f7-41fe-9f92-2581c01532d9'} May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:56:19.326129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:56:19.327346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:56:19.328427 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0bdf18fa-6939-49a4-aa9d-0d5f2b365a56 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:56:19.328427 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0bdf18fa-6939-49a4-aa9d-0d5f2b365a56 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 404 len: 111 microversion: 2.1 time: 0.030098 May 23 10:56:19.328427 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 283/572] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:19 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:56:19.334845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4027aa55-91f5-43a8-80ba-ccbcdcacb8f7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '.version_select at 0x7fe720046940>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:19.351604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4027aa55-91f5-43a8-80ba-ccbcdcacb8f7 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077688309" status: 202 len: 0 microversion: 2.1 time: 0.021043 May 23 10:56:19.352180 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 290/573] 10.222.0.36 () {58 vars in 1220 bytes} [Mon May 23 10:56:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077688309 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:56:19.797001 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-76cc79e7-4283-49c8-884f-4ae5a5b3d4d6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:19.797633 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-76cc79e7-4283-49c8-884f-4ae5a5b3d4d6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:19.804211 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76cc79e7-4283-49c8-884f-4ae5a5b3d4d6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:19.804676 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76cc79e7-4283-49c8-884f-4ae5a5b3d4d6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:19.805447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76cc79e7-4283-49c8-884f-4ae5a5b3d4d6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:19.805893 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76cc79e7-4283-49c8-884f-4ae5a5b3d4d6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:19.999544 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ac5352c4-1021-44d9-a804-3ae8d6353a3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: .version_select at 0x7fe720077670>, body: {"keypair": {"name": "tempest-keypair-1965719522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHitqJLRXpaHpfY5TTNnmLiDBg/44m/ydtfd4zhoiDTA4cfe4jLKHvdFn5xMwGJyx8AandguvRclmKYk0w0P0MFLwVqfU3+oEnig04kger72LD68Goc53qP2blbGsD5eQ=="}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:20.008126 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-76cc79e7-4283-49c8-884f-4ae5a5b3d4d6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:20.014126 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-ac5352c4-1021-44d9-a804-3ae8d6353a3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:56:20.016109 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-76cc79e7-4283-49c8-884f-4ae5a5b3d4d6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:20.017612 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-76cc79e7-4283-49c8-884f-4ae5a5b3d4d6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:20.018680 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-ac5352c4-1021-44d9-a804-3ae8d6353a3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for user 8e98c8ceac6b47079423b45685c5ba3e and project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:56:20.018803 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-76cc79e7-4283-49c8-884f-4ae5a5b3d4d6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.226110 May 23 10:56:20.019559 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 284/574] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:19 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:20.040379 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ac5352c4-1021-44d9-a804-3ae8d6353a3d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045222 May 23 10:56:20.040968 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 291/575] 10.222.0.36 () {60 vars in 1158 bytes} [Mon May 23 10:56:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:56:21.038400 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9d4d79e1-b6c9-4c0d-926e-575f5f65626b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:21.039044 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9d4d79e1-b6c9-4c0d-926e-575f5f65626b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:21.045576 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9d4d79e1-b6c9-4c0d-926e-575f5f65626b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:21.046075 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9d4d79e1-b6c9-4c0d-926e-575f5f65626b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:21.046856 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9d4d79e1-b6c9-4c0d-926e-575f5f65626b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:21.047301 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9d4d79e1-b6c9-4c0d-926e-575f5f65626b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:21.487396 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-9d4d79e1-b6c9-4c0d-926e-575f5f65626b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:21.496257 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-9d4d79e1-b6c9-4c0d-926e-575f5f65626b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:21.497873 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-9d4d79e1-b6c9-4c0d-926e-575f5f65626b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:21.499277 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9d4d79e1-b6c9-4c0d-926e-575f5f65626b tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.465450 May 23 10:56:21.499982 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 285/576] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:21 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:21.556266 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-627629063", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6500cd5-4edf-47aa-9e35-9691dad60917"}], "security_groups": [{"name": "tempest-securitygroup--1306161870"}], "key_name": "tempest-keypair-1965719522", "user_data": "}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:21.656437 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] validate_networks() for [('f6500cd5-4edf-47aa-9e35-9691dad60917', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:56:22.008919 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:56:22.009288 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:56:22.009785 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:56:22.010231 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:56:22.010641 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:56:22.019330 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:22.019777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:22.021400 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:22.021833 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:22.039452 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:56:22.043401 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Getting quotas for user 8e98c8ceac6b47079423b45685c5ba3e and project 00d4a5543a3f41a6b3dab9250c0ce9be. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:56:22.054393 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:56:22.056657 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:56:22.103180 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-259511c5-0929-4083-b711-2e9ac6101a01 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.552280 May 23 10:56:22.103828 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 292/577] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:56:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:56:22.114190 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e7fcc8d3-21c2-419b-b9df-c4a6f53c215b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:22.114805 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e7fcc8d3-21c2-419b-b9df-c4a6f53c215b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:22.166484 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e7fcc8d3-21c2-419b-b9df-c4a6f53c215b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:22.173093 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e7fcc8d3-21c2-419b-b9df-c4a6f53c215b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1241 microversion: 2.1 time: 0.063262 May 23 10:56:22.173664 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 286/578] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:22 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:22.519265 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-31c807cc-6a66-412f-b891-122695bb566a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:22.520778 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-31c807cc-6a66-412f-b891-122695bb566a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:22.527431 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-31c807cc-6a66-412f-b891-122695bb566a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:22.527872 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-31c807cc-6a66-412f-b891-122695bb566a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:22.528632 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-31c807cc-6a66-412f-b891-122695bb566a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:22.529059 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-31c807cc-6a66-412f-b891-122695bb566a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:22.657905 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-31c807cc-6a66-412f-b891-122695bb566a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:22.665773 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-31c807cc-6a66-412f-b891-122695bb566a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:22.667294 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-31c807cc-6a66-412f-b891-122695bb566a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:22.668438 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-31c807cc-6a66-412f-b891-122695bb566a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.153154 May 23 10:56:22.668994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 293/579] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:22 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:23.196925 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c4d66e35-46e6-43a7-84ff-e2f5420f7c74 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:23.198147 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c4d66e35-46e6-43a7-84ff-e2f5420f7c74 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:23.206760 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4d66e35-46e6-43a7-84ff-e2f5420f7c74 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:23.207162 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4d66e35-46e6-43a7-84ff-e2f5420f7c74 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:23.210490 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4d66e35-46e6-43a7-84ff-e2f5420f7c74 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:23.210962 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4d66e35-46e6-43a7-84ff-e2f5420f7c74 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:23.285472 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c4d66e35-46e6-43a7-84ff-e2f5420f7c74 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:23.293789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c4d66e35-46e6-43a7-84ff-e2f5420f7c74 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1311 microversion: 2.1 time: 0.106976 May 23 10:56:23.294545 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 287/580] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:23 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:23.686927 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d481fe90-616f-4a35-a825-11b6a6318d62 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:23.687533 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d481fe90-616f-4a35-a825-11b6a6318d62 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:23.694241 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d481fe90-616f-4a35-a825-11b6a6318d62 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:23.694690 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d481fe90-616f-4a35-a825-11b6a6318d62 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:23.695483 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d481fe90-616f-4a35-a825-11b6a6318d62 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:23.695919 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d481fe90-616f-4a35-a825-11b6a6318d62 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:23.823142 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d481fe90-616f-4a35-a825-11b6a6318d62 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:23.831411 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d481fe90-616f-4a35-a825-11b6a6318d62 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:23.833447 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d481fe90-616f-4a35-a825-11b6a6318d62 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:23.834677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d481fe90-616f-4a35-a825-11b6a6318d62 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.151652 May 23 10:56:23.835239 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 294/581] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:23 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:24.310605 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-42d1b94d-8b0a-4b26-a6fb-b74c84f60297 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:24.311337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-42d1b94d-8b0a-4b26-a6fb-b74c84f60297 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:24.318232 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-42d1b94d-8b0a-4b26-a6fb-b74c84f60297 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:24.318681 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-42d1b94d-8b0a-4b26-a6fb-b74c84f60297 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:24.319449 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-42d1b94d-8b0a-4b26-a6fb-b74c84f60297 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:24.319885 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-42d1b94d-8b0a-4b26-a6fb-b74c84f60297 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:24.544042 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-42d1b94d-8b0a-4b26-a6fb-b74c84f60297 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:24.552264 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-42d1b94d-8b0a-4b26-a6fb-b74c84f60297 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1367 microversion: 2.1 time: 0.244921 May 23 10:56:24.553421 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 288/582] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:24 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:24.726877 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-2cbefd76-6bd9-477b-b2e4-1256d4607c7c req-685c513b-80b5-4eb4-aa70-94db6b3ee95d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b7452a-2695-4e9e-9ad4-c72f9c820594", "tag": "6df75980-9946-423c-9150-f2fe9406a3f6"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:24.740413 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-2cbefd76-6bd9-477b-b2e4-1256d4607c7c req-685c513b-80b5-4eb4-aa70-94db6b3ee95d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:24.740860 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-2cbefd76-6bd9-477b-b2e4-1256d4607c7c req-685c513b-80b5-4eb4-aa70-94db6b3ee95d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:24.752393 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-2cbefd76-6bd9-477b-b2e4-1256d4607c7c req-685c513b-80b5-4eb4-aa70-94db6b3ee95d service nova] Creating event network-changed:6df75980-9946-423c-9150-f2fe9406a3f6 for instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 on hv-cinder-83699 May 23 10:56:24.757063 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-2cbefd76-6bd9-477b-b2e4-1256d4607c7c req-685c513b-80b5-4eb4-aa70-94db6b3ee95d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035065 May 23 10:56:24.758015 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 295/583] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:56:24.853345 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6be4724f-8d12-4db0-8130-a444eb54fadb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:24.854157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6be4724f-8d12-4db0-8130-a444eb54fadb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:24.860481 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6be4724f-8d12-4db0-8130-a444eb54fadb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:24.861025 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6be4724f-8d12-4db0-8130-a444eb54fadb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:24.861891 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6be4724f-8d12-4db0-8130-a444eb54fadb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:24.862449 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6be4724f-8d12-4db0-8130-a444eb54fadb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:25.091512 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6be4724f-8d12-4db0-8130-a444eb54fadb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:25.099926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6be4724f-8d12-4db0-8130-a444eb54fadb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:25.101467 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6be4724f-8d12-4db0-8130-a444eb54fadb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:25.102655 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6be4724f-8d12-4db0-8130-a444eb54fadb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.253276 May 23 10:56:25.103217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 289/584] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:24 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:25.570665 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-44ad438f-e07e-4323-8fa3-e54ce713f106 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:25.571328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-44ad438f-e07e-4323-8fa3-e54ce713f106 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:25.577428 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-44ad438f-e07e-4323-8fa3-e54ce713f106 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:25.577871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-44ad438f-e07e-4323-8fa3-e54ce713f106 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:25.578656 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-44ad438f-e07e-4323-8fa3-e54ce713f106 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:25.579087 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-44ad438f-e07e-4323-8fa3-e54ce713f106 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:25.707519 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-44ad438f-e07e-4323-8fa3-e54ce713f106 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:25.715818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-44ad438f-e07e-4323-8fa3-e54ce713f106 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1367 microversion: 2.1 time: 0.149911 May 23 10:56:25.716385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 296/585] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:25 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:26.121039 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d67f72a0-8dea-4ea5-bb2b-4c37835d2472 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:26.121564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d67f72a0-8dea-4ea5-bb2b-4c37835d2472 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:26.128009 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d67f72a0-8dea-4ea5-bb2b-4c37835d2472 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:26.128449 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d67f72a0-8dea-4ea5-bb2b-4c37835d2472 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:26.129200 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d67f72a0-8dea-4ea5-bb2b-4c37835d2472 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:26.130268 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d67f72a0-8dea-4ea5-bb2b-4c37835d2472 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:26.287365 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d67f72a0-8dea-4ea5-bb2b-4c37835d2472 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:26.295282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d67f72a0-8dea-4ea5-bb2b-4c37835d2472 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:26.296793 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d67f72a0-8dea-4ea5-bb2b-4c37835d2472 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:26.298081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d67f72a0-8dea-4ea5-bb2b-4c37835d2472 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.180935 May 23 10:56:26.298952 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 290/586] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:26 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:26.733115 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2541e69e-a0b0-4fa5-b364-ca2e83678557 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:26.734099 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2541e69e-a0b0-4fa5-b364-ca2e83678557 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:26.740587 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2541e69e-a0b0-4fa5-b364-ca2e83678557 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:26.741108 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2541e69e-a0b0-4fa5-b364-ca2e83678557 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:26.741876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2541e69e-a0b0-4fa5-b364-ca2e83678557 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:26.742335 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2541e69e-a0b0-4fa5-b364-ca2e83678557 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:26.866075 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2541e69e-a0b0-4fa5-b364-ca2e83678557 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:26.873383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2541e69e-a0b0-4fa5-b364-ca2e83678557 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1367 microversion: 2.1 time: 0.144814 May 23 10:56:26.873959 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 297/587] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:26 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:27.316770 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-44f6f443-c78d-40ac-8891-a8fca5b8b8d3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:27.317881 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-44f6f443-c78d-40ac-8891-a8fca5b8b8d3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:27.324394 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-44f6f443-c78d-40ac-8891-a8fca5b8b8d3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:27.324840 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-44f6f443-c78d-40ac-8891-a8fca5b8b8d3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:27.325601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-44f6f443-c78d-40ac-8891-a8fca5b8b8d3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:27.326067 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-44f6f443-c78d-40ac-8891-a8fca5b8b8d3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:27.455926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-44f6f443-c78d-40ac-8891-a8fca5b8b8d3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:27.463872 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-44f6f443-c78d-40ac-8891-a8fca5b8b8d3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:27.465370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-44f6f443-c78d-40ac-8891-a8fca5b8b8d3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:27.466566 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-44f6f443-c78d-40ac-8891-a8fca5b8b8d3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.153750 May 23 10:56:27.467136 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 291/588] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:27 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:27.889994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cf975c18-1bbf-4bdb-ac0e-6d7d8e924698 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:27.890595 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-cf975c18-1bbf-4bdb-ac0e-6d7d8e924698 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:27.897400 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cf975c18-1bbf-4bdb-ac0e-6d7d8e924698 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:27.897836 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cf975c18-1bbf-4bdb-ac0e-6d7d8e924698 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:27.898607 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cf975c18-1bbf-4bdb-ac0e-6d7d8e924698 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:27.899040 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cf975c18-1bbf-4bdb-ac0e-6d7d8e924698 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:28.031416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-cf975c18-1bbf-4bdb-ac0e-6d7d8e924698 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:28.039321 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-cf975c18-1bbf-4bdb-ac0e-6d7d8e924698 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1367 microversion: 2.1 time: 0.153211 May 23 10:56:28.039880 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 298/589] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:27 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:28.484702 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-95afeb18-defb-4e0b-9a5c-aea61cad4c8a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:28.485309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-95afeb18-defb-4e0b-9a5c-aea61cad4c8a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:28.491909 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-95afeb18-defb-4e0b-9a5c-aea61cad4c8a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:28.492361 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-95afeb18-defb-4e0b-9a5c-aea61cad4c8a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:28.493129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-95afeb18-defb-4e0b-9a5c-aea61cad4c8a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:28.493570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-95afeb18-defb-4e0b-9a5c-aea61cad4c8a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:28.620594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-95afeb18-defb-4e0b-9a5c-aea61cad4c8a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:28.628680 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-95afeb18-defb-4e0b-9a5c-aea61cad4c8a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:28.630763 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-95afeb18-defb-4e0b-9a5c-aea61cad4c8a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:28.631911 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-95afeb18-defb-4e0b-9a5c-aea61cad4c8a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.151159 May 23 10:56:28.632474 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 292/590] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:28 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:29.055610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-47409dc0-a57e-4f6c-bcbd-69d52e84921d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:29.056219 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-47409dc0-a57e-4f6c-bcbd-69d52e84921d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:29.062861 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47409dc0-a57e-4f6c-bcbd-69d52e84921d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:29.063310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47409dc0-a57e-4f6c-bcbd-69d52e84921d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:29.064120 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47409dc0-a57e-4f6c-bcbd-69d52e84921d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:29.064548 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-47409dc0-a57e-4f6c-bcbd-69d52e84921d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:29.191572 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-47409dc0-a57e-4f6c-bcbd-69d52e84921d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:29.199490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-47409dc0-a57e-4f6c-bcbd-69d52e84921d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1367 microversion: 2.1 time: 0.148285 May 23 10:56:29.200058 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 299/591] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:29 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:29.650813 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c38c3599-e6ea-4559-b9c8-ac006f08cdbe tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:29.651416 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c38c3599-e6ea-4559-b9c8-ac006f08cdbe tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:29.657879 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c38c3599-e6ea-4559-b9c8-ac006f08cdbe tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:29.658351 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c38c3599-e6ea-4559-b9c8-ac006f08cdbe tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:29.659127 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c38c3599-e6ea-4559-b9c8-ac006f08cdbe tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:29.659560 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c38c3599-e6ea-4559-b9c8-ac006f08cdbe tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:29.786966 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c38c3599-e6ea-4559-b9c8-ac006f08cdbe tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:29.794879 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c38c3599-e6ea-4559-b9c8-ac006f08cdbe tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:29.796368 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c38c3599-e6ea-4559-b9c8-ac006f08cdbe tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:29.797527 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c38c3599-e6ea-4559-b9c8-ac006f08cdbe tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.150579 May 23 10:56:29.798126 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 293/592] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:29 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:56:30.216034 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-95c1aa99-7e48-43f9-97aa-6d28c5fa259e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:30.216642 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-95c1aa99-7e48-43f9-97aa-6d28c5fa259e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:30.223255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95c1aa99-7e48-43f9-97aa-6d28c5fa259e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:30.223703 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95c1aa99-7e48-43f9-97aa-6d28c5fa259e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:30.224463 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95c1aa99-7e48-43f9-97aa-6d28c5fa259e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:30.224912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-95c1aa99-7e48-43f9-97aa-6d28c5fa259e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:30.357413 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-95c1aa99-7e48-43f9-97aa-6d28c5fa259e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:30.365406 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-95c1aa99-7e48-43f9-97aa-6d28c5fa259e tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1367 microversion: 2.1 time: 0.153240 May 23 10:56:30.365979 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 300/593] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:30 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:30.434342 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-b52124b6-3b3f-4960-869f-245e17a57c7c req-c390ccda-36c7-4d05-84de-4fd87609622e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b7452a-2695-4e9e-9ad4-c72f9c820594", "name": "network-vif-plugged", "status": "completed", "tag": "6df75980-9946-423c-9150-f2fe9406a3f6"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:30.443053 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-b52124b6-3b3f-4960-869f-245e17a57c7c req-c390ccda-36c7-4d05-84de-4fd87609622e service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:30.443504 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-b52124b6-3b3f-4960-869f-245e17a57c7c req-c390ccda-36c7-4d05-84de-4fd87609622e service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:30.454412 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-b52124b6-3b3f-4960-869f-245e17a57c7c req-c390ccda-36c7-4d05-84de-4fd87609622e service nova] Creating event network-vif-plugged:6df75980-9946-423c-9150-f2fe9406a3f6 for instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 on hv-cinder-83699 May 23 10:56:30.459302 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-b52124b6-3b3f-4960-869f-245e17a57c7c req-c390ccda-36c7-4d05-84de-4fd87609622e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028672 May 23 10:56:30.459897 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 294/594] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:30.814969 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e7f9090a-32b8-42f3-97c9-2fca6e773e14 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:30.815577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e7f9090a-32b8-42f3-97c9-2fca6e773e14 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:30.822125 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7f9090a-32b8-42f3-97c9-2fca6e773e14 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:30.822578 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7f9090a-32b8-42f3-97c9-2fca6e773e14 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:30.823345 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7f9090a-32b8-42f3-97c9-2fca6e773e14 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:30.823784 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e7f9090a-32b8-42f3-97c9-2fca6e773e14 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:30.946534 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e7f9090a-32b8-42f3-97c9-2fca6e773e14 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:30.954323 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e7f9090a-32b8-42f3-97c9-2fca6e773e14 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:30.955813 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e7f9090a-32b8-42f3-97c9-2fca6e773e14 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:30.956964 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e7f9090a-32b8-42f3-97c9-2fca6e773e14 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.145872 May 23 10:56:30.958147 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 301/595] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:30 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:31.383236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-05beaf56-7733-4823-91b8-e0901eee681a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:31.383942 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-05beaf56-7733-4823-91b8-e0901eee681a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:31.390228 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-05beaf56-7733-4823-91b8-e0901eee681a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:31.390680 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-05beaf56-7733-4823-91b8-e0901eee681a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:31.391451 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-05beaf56-7733-4823-91b8-e0901eee681a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:31.391890 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-05beaf56-7733-4823-91b8-e0901eee681a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:31.519077 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-05beaf56-7733-4823-91b8-e0901eee681a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:31.526812 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-05beaf56-7733-4823-91b8-e0901eee681a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1367 microversion: 2.1 time: 0.148857 May 23 10:56:31.527391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 295/596] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:31 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:31.976505 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-72b6d352-bd62-45e3-b907-590c90263fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:31.977136 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-72b6d352-bd62-45e3-b907-590c90263fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:31.983514 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-72b6d352-bd62-45e3-b907-590c90263fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:31.983962 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-72b6d352-bd62-45e3-b907-590c90263fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:31.984728 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-72b6d352-bd62-45e3-b907-590c90263fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:31.985408 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-72b6d352-bd62-45e3-b907-590c90263fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:32.029862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:32.049876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=10 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:32.117388 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-72b6d352-bd62-45e3-b907-590c90263fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:32.125392 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-72b6d352-bd62-45e3-b907-590c90263fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:32.126915 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-72b6d352-bd62-45e3-b907-590c90263fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:32.128105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-72b6d352-bd62-45e3-b907-590c90263fd4 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.156121 May 23 10:56:32.128652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 302/597] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:31 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:32.544539 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4b21731d-2fed-45cb-88f8-ee6ae08e4d98 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:32.545140 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4b21731d-2fed-45cb-88f8-ee6ae08e4d98 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:32.547113 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:32.552972 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4b21731d-2fed-45cb-88f8-ee6ae08e4d98 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:32.553415 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4b21731d-2fed-45cb-88f8-ee6ae08e4d98 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:32.554202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4b21731d-2fed-45cb-88f8-ee6ae08e4d98 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:32.554634 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4b21731d-2fed-45cb-88f8-ee6ae08e4d98 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:32.683890 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4b21731d-2fed-45cb-88f8-ee6ae08e4d98 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:32.691410 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4b21731d-2fed-45cb-88f8-ee6ae08e4d98 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1556 microversion: 2.1 time: 0.150833 May 23 10:56:32.692626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 296/598] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:56:32 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:56:32.707871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3460f594-591a-4448-af52-db861be44981 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:32.708364 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3460f594-591a-4448-af52-db861be44981 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:32.714387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3460f594-591a-4448-af52-db861be44981 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:32.714829 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3460f594-591a-4448-af52-db861be44981 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:32.715583 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3460f594-591a-4448-af52-db861be44981 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:32.716011 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3460f594-591a-4448-af52-db861be44981 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:32.794038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3460f594-591a-4448-af52-db861be44981 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089897 May 23 10:56:32.794708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 303/599] 10.222.0.36 () {58 vars in 1274 bytes} [Mon May 23 10:56:32 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:33.146555 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-275eba04-0ac5-46c0-a53c-cc5edcf27716 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:33.147076 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-275eba04-0ac5-46c0-a53c-cc5edcf27716 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:33.153389 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-275eba04-0ac5-46c0-a53c-cc5edcf27716 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:33.153842 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-275eba04-0ac5-46c0-a53c-cc5edcf27716 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:33.154658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-275eba04-0ac5-46c0-a53c-cc5edcf27716 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:33.155095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-275eba04-0ac5-46c0-a53c-cc5edcf27716 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:33.290446 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-275eba04-0ac5-46c0-a53c-cc5edcf27716 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:33.298427 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-275eba04-0ac5-46c0-a53c-cc5edcf27716 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:33.299925 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-275eba04-0ac5-46c0-a53c-cc5edcf27716 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:33.301074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-275eba04-0ac5-46c0-a53c-cc5edcf27716 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1745 microversion: 2.20 time: 0.158984 May 23 10:56:33.302347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 297/600] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:33 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:33.912973 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-55bba2ea-4fc4-4f09-b872-93c936cba2c1 req-189b8e11-bce1-4171-bbbb-8ab02c8c0cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b7452a-2695-4e9e-9ad4-c72f9c820594", "tag": "6df75980-9946-423c-9150-f2fe9406a3f6"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:33.921035 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-55bba2ea-4fc4-4f09-b872-93c936cba2c1 req-189b8e11-bce1-4171-bbbb-8ab02c8c0cb1 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:33.921483 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-55bba2ea-4fc4-4f09-b872-93c936cba2c1 req-189b8e11-bce1-4171-bbbb-8ab02c8c0cb1 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:33.932441 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-55bba2ea-4fc4-4f09-b872-93c936cba2c1 req-189b8e11-bce1-4171-bbbb-8ab02c8c0cb1 service nova] Creating event network-changed:6df75980-9946-423c-9150-f2fe9406a3f6 for instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 on hv-cinder-83699 May 23 10:56:33.937666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-55bba2ea-4fc4-4f09-b872-93c936cba2c1 req-189b8e11-bce1-4171-bbbb-8ab02c8c0cb1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028899 May 23 10:56:33.938561 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 304/601] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:34.320986 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3b9477b3-3dd8-4fb9-ba63-25625a30c67f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:34.321631 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3b9477b3-3dd8-4fb9-ba63-25625a30c67f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:34.329313 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b9477b3-3dd8-4fb9-ba63-25625a30c67f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:34.329767 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b9477b3-3dd8-4fb9-ba63-25625a30c67f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:34.330579 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b9477b3-3dd8-4fb9-ba63-25625a30c67f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:34.331023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b9477b3-3dd8-4fb9-ba63-25625a30c67f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:34.534060 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3b9477b3-3dd8-4fb9-ba63-25625a30c67f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:34.542795 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3b9477b3-3dd8-4fb9-ba63-25625a30c67f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:34.544308 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3b9477b3-3dd8-4fb9-ba63-25625a30c67f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:34.545489 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3b9477b3-3dd8-4fb9-ba63-25625a30c67f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1745 microversion: 2.20 time: 0.229057 May 23 10:56:34.546282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 298/602] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:34 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1745 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:56:35.564794 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4da8f6bb-3088-4de7-b83d-ea972503826d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:35.565481 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-4da8f6bb-3088-4de7-b83d-ea972503826d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:35.577079 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4da8f6bb-3088-4de7-b83d-ea972503826d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:35.577522 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4da8f6bb-3088-4de7-b83d-ea972503826d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:35.578317 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4da8f6bb-3088-4de7-b83d-ea972503826d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:35.578751 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4da8f6bb-3088-4de7-b83d-ea972503826d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:35.708124 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-4da8f6bb-3088-4de7-b83d-ea972503826d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:35.715816 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-4da8f6bb-3088-4de7-b83d-ea972503826d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:35.717288 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-4da8f6bb-3088-4de7-b83d-ea972503826d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:35.718477 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4da8f6bb-3088-4de7-b83d-ea972503826d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1745 microversion: 2.20 time: 0.157914 May 23 10:56:35.719040 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 305/603] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:35 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:36.736536 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3e03ab63-2d00-4d3d-a908-eb2b0941a379 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:36.741852 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3e03ab63-2d00-4d3d-a908-eb2b0941a379 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:36.758170 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3e03ab63-2d00-4d3d-a908-eb2b0941a379 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:36.758686 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3e03ab63-2d00-4d3d-a908-eb2b0941a379 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:36.759534 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3e03ab63-2d00-4d3d-a908-eb2b0941a379 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:36.760599 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3e03ab63-2d00-4d3d-a908-eb2b0941a379 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:36.922524 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3e03ab63-2d00-4d3d-a908-eb2b0941a379 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:36.930981 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3e03ab63-2d00-4d3d-a908-eb2b0941a379 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:36.932505 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3e03ab63-2d00-4d3d-a908-eb2b0941a379 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:36.933689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3e03ab63-2d00-4d3d-a908-eb2b0941a379 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1740 microversion: 2.20 time: 0.201161 May 23 10:56:36.942181 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 299/604] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:36 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:37.952603 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-70e4727f-16a4-44bc-9fa8-2025d7085b22 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:37.953566 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-70e4727f-16a4-44bc-9fa8-2025d7085b22 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:37.965099 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-70e4727f-16a4-44bc-9fa8-2025d7085b22 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:37.965659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-70e4727f-16a4-44bc-9fa8-2025d7085b22 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:37.966751 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-70e4727f-16a4-44bc-9fa8-2025d7085b22 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:37.967388 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-70e4727f-16a4-44bc-9fa8-2025d7085b22 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:38.125175 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-70e4727f-16a4-44bc-9fa8-2025d7085b22 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:38.133620 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-70e4727f-16a4-44bc-9fa8-2025d7085b22 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:38.135527 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-70e4727f-16a4-44bc-9fa8-2025d7085b22 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:38.136948 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-70e4727f-16a4-44bc-9fa8-2025d7085b22 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1740 microversion: 2.20 time: 0.188219 May 23 10:56:38.147121 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 306/605] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:37 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:38.511544 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-5a3617ea-a823-4e19-9ee5-5bf6b59eb8c9 req-8a4a31c1-810c-4cbf-b493-125e5ac2e4cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde224c6-c41a-4424-8bc4-bd8f62d9fa53", "name": "network-vif-plugged", "status": "completed", "tag": "40b35beb-6f47-44de-835b-56925cd7ae0f"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:38.526694 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-5a3617ea-a823-4e19-9ee5-5bf6b59eb8c9 req-8a4a31c1-810c-4cbf-b493-125e5ac2e4cc service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:38.527440 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-5a3617ea-a823-4e19-9ee5-5bf6b59eb8c9 req-8a4a31c1-810c-4cbf-b493-125e5ac2e4cc service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:38.539837 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-5a3617ea-a823-4e19-9ee5-5bf6b59eb8c9 req-8a4a31c1-810c-4cbf-b493-125e5ac2e4cc service nova] Creating event network-vif-plugged:40b35beb-6f47-44de-835b-56925cd7ae0f for instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 on hv-cinder-83699 May 23 10:56:38.545573 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-5a3617ea-a823-4e19-9ee5-5bf6b59eb8c9 req-8a4a31c1-810c-4cbf-b493-125e5ac2e4cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037640 May 23 10:56:38.546924 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 300/606] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:56:39.158828 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e95d206d-aa7f-4a15-865a-80395ee2f211 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:39.160040 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e95d206d-aa7f-4a15-865a-80395ee2f211 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:39.168009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e95d206d-aa7f-4a15-865a-80395ee2f211 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:39.168467 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e95d206d-aa7f-4a15-865a-80395ee2f211 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:39.169251 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e95d206d-aa7f-4a15-865a-80395ee2f211 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:39.169685 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e95d206d-aa7f-4a15-865a-80395ee2f211 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:39.485566 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e95d206d-aa7f-4a15-865a-80395ee2f211 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:39.494141 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e95d206d-aa7f-4a15-865a-80395ee2f211 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:39.496095 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e95d206d-aa7f-4a15-865a-80395ee2f211 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:39.497375 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e95d206d-aa7f-4a15-865a-80395ee2f211 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1740 microversion: 2.20 time: 0.342567 May 23 10:56:39.507952 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 307/607] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:39 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1740 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:40.516488 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1971f57b-b4e7-47f4-91f6-877c686ade86 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:40.517108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1971f57b-b4e7-47f4-91f6-877c686ade86 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:40.524506 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1971f57b-b4e7-47f4-91f6-877c686ade86 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:40.525056 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1971f57b-b4e7-47f4-91f6-877c686ade86 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:40.526315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1971f57b-b4e7-47f4-91f6-877c686ade86 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:40.526840 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1971f57b-b4e7-47f4-91f6-877c686ade86 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:40.546686 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=100 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:40.727296 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1971f57b-b4e7-47f4-91f6-877c686ade86 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:40.735271 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1971f57b-b4e7-47f4-91f6-877c686ade86 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:40.736859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1971f57b-b4e7-47f4-91f6-877c686ade86 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:40.738226 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1971f57b-b4e7-47f4-91f6-877c686ade86 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1740 microversion: 2.20 time: 0.226156 May 23 10:56:40.739674 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 301/608] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:40 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:40.972594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 10:56:40.973605 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Mon May 23 10:56:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 10:56:41.757429 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f124ee63-03e1-4df0-94cb-97085067c934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:41.758117 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f124ee63-03e1-4df0-94cb-97085067c934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:41.760591 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:41.765988 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f124ee63-03e1-4df0-94cb-97085067c934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:41.766728 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f124ee63-03e1-4df0-94cb-97085067c934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:41.767749 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f124ee63-03e1-4df0-94cb-97085067c934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:41.768424 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f124ee63-03e1-4df0-94cb-97085067c934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:41.907676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f124ee63-03e1-4df0-94cb-97085067c934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:41.909980 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:41.918142 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f124ee63-03e1-4df0-94cb-97085067c934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:41.919654 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f124ee63-03e1-4df0-94cb-97085067c934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:41.920834 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f124ee63-03e1-4df0-94cb-97085067c934 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1740 microversion: 2.20 time: 0.167972 May 23 10:56:41.921402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 308/609] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:41 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:42.940195 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f917f11c-956b-4cfa-8008-8f96eccbde5e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:42.940910 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f917f11c-956b-4cfa-8008-8f96eccbde5e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:42.943981 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=62 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:42.950423 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f917f11c-956b-4cfa-8008-8f96eccbde5e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:42.950965 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f917f11c-956b-4cfa-8008-8f96eccbde5e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:42.951930 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f917f11c-956b-4cfa-8008-8f96eccbde5e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:42.952365 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f917f11c-956b-4cfa-8008-8f96eccbde5e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:43.109688 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f917f11c-956b-4cfa-8008-8f96eccbde5e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:43.118768 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f917f11c-956b-4cfa-8008-8f96eccbde5e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:43.120651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f917f11c-956b-4cfa-8008-8f96eccbde5e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:43.122895 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f917f11c-956b-4cfa-8008-8f96eccbde5e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1740 microversion: 2.20 time: 0.185793 May 23 10:56:43.123978 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 302/610] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:42 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:43.654336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-df9d9a96-e4b3-40c2-b684-97f90cfbbb86 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:43.654982 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-df9d9a96-e4b3-40c2-b684-97f90cfbbb86 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:43.662907 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-df9d9a96-e4b3-40c2-b684-97f90cfbbb86 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:43.663592 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-df9d9a96-e4b3-40c2-b684-97f90cfbbb86 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:43.664536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-df9d9a96-e4b3-40c2-b684-97f90cfbbb86 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:43.664999 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-df9d9a96-e4b3-40c2-b684-97f90cfbbb86 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:43.690169 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-df9d9a96-e4b3-40c2-b684-97f90cfbbb86 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/ips" status: 200 len: 147 microversion: 2.1 time: 0.039428 May 23 10:56:43.690719 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 309/611] 10.222.0.36 () {58 vars in 1247 bytes} [Mon May 23 10:56:43 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:44.142713 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-30618828-ead9-44c4-b969-cf23734720fb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:44.143328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-30618828-ead9-44c4-b969-cf23734720fb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:44.151386 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-30618828-ead9-44c4-b969-cf23734720fb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:44.152256 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-30618828-ead9-44c4-b969-cf23734720fb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:44.153283 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-30618828-ead9-44c4-b969-cf23734720fb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:44.153732 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-30618828-ead9-44c4-b969-cf23734720fb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:44.306491 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-30618828-ead9-44c4-b969-cf23734720fb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:44.314502 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-30618828-ead9-44c4-b969-cf23734720fb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:44.315987 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-30618828-ead9-44c4-b969-cf23734720fb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:44.317655 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-30618828-ead9-44c4-b969-cf23734720fb tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1740 microversion: 2.20 time: 0.179077 May 23 10:56:44.318287 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 303/612] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:44 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:56:45.057395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ca40a6bb-b556-4419-9bce-b11ff52ed55d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c3e3d57-7172-4d20-915e-f480b88f3a97"}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:45.058616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ca40a6bb-b556-4419-9bce-b11ff52ed55d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:45.065401 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ca40a6bb-b556-4419-9bce-b11ff52ed55d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:45.066049 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ca40a6bb-b556-4419-9bce-b11ff52ed55d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:45.067340 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ca40a6bb-b556-4419-9bce-b11ff52ed55d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:45.067994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ca40a6bb-b556-4419-9bce-b11ff52ed55d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:45.336665 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-91cc42b1-6cfa-452a-85f6-c145366fb866 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:45.337266 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-91cc42b1-6cfa-452a-85f6-c145366fb866 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:45.343678 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91cc42b1-6cfa-452a-85f6-c145366fb866 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:45.344105 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91cc42b1-6cfa-452a-85f6-c145366fb866 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:45.344874 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91cc42b1-6cfa-452a-85f6-c145366fb866 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:45.345302 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-91cc42b1-6cfa-452a-85f6-c145366fb866 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:45.376272 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ca40a6bb-b556-4419-9bce-b11ff52ed55d tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322578 May 23 10:56:45.376879 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 310/613] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:56:45 2022] POST /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:45.478536 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-91cc42b1-6cfa-452a-85f6-c145366fb866 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:45.486432 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-91cc42b1-6cfa-452a-85f6-c145366fb866 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:45.487911 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-91cc42b1-6cfa-452a-85f6-c145366fb866 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:45.489190 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-91cc42b1-6cfa-452a-85f6-c145366fb866 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1740 microversion: 2.20 time: 0.156990 May 23 10:56:45.489748 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 304/614] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:45 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:56:46.508240 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c740165f-21e3-4a02-a084-f32df66db8aa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:46.508935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c740165f-21e3-4a02-a084-f32df66db8aa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:46.515162 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c740165f-21e3-4a02-a084-f32df66db8aa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:46.515611 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c740165f-21e3-4a02-a084-f32df66db8aa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:46.516372 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c740165f-21e3-4a02-a084-f32df66db8aa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:46.516809 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c740165f-21e3-4a02-a084-f32df66db8aa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:46.646051 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c740165f-21e3-4a02-a084-f32df66db8aa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:46.653866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c740165f-21e3-4a02-a084-f32df66db8aa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:46.655393 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c740165f-21e3-4a02-a084-f32df66db8aa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:46.656550 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c740165f-21e3-4a02-a084-f32df66db8aa tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1722 microversion: 2.20 time: 0.153129 May 23 10:56:46.657137 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 311/615] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:46 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:47.675268 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0a6e43c4-4ef7-4b88-8d06-e7ac216521ac tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:47.676369 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0a6e43c4-4ef7-4b88-8d06-e7ac216521ac tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:47.682865 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0a6e43c4-4ef7-4b88-8d06-e7ac216521ac tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:47.683310 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0a6e43c4-4ef7-4b88-8d06-e7ac216521ac tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:47.684062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0a6e43c4-4ef7-4b88-8d06-e7ac216521ac tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:47.684491 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0a6e43c4-4ef7-4b88-8d06-e7ac216521ac tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:47.808786 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0a6e43c4-4ef7-4b88-8d06-e7ac216521ac tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:47.817114 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0a6e43c4-4ef7-4b88-8d06-e7ac216521ac tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:47.818654 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0a6e43c4-4ef7-4b88-8d06-e7ac216521ac tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:47.819798 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0a6e43c4-4ef7-4b88-8d06-e7ac216521ac tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1722 microversion: 2.20 time: 0.148393 May 23 10:56:47.820352 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 305/616] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:47 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:48.838340 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9f03c9de-81cd-43a2-99ad-c35595a48521 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:48.838983 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9f03c9de-81cd-43a2-99ad-c35595a48521 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:48.845474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f03c9de-81cd-43a2-99ad-c35595a48521 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:48.845928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f03c9de-81cd-43a2-99ad-c35595a48521 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:48.846725 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f03c9de-81cd-43a2-99ad-c35595a48521 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:48.847164 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f03c9de-81cd-43a2-99ad-c35595a48521 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:48.970866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9f03c9de-81cd-43a2-99ad-c35595a48521 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:48.978604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9f03c9de-81cd-43a2-99ad-c35595a48521 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:48.980105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9f03c9de-81cd-43a2-99ad-c35595a48521 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:48.981264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9f03c9de-81cd-43a2-99ad-c35595a48521 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1665 microversion: 2.20 time: 0.146825 May 23 10:56:48.981824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 312/617] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:48 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1665 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:48.998631 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d2d8844e-facf-4ea1-8b46-b38103af33ce tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de59d567-8e78-48ed-b307-4ed69cd8534c"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:48.999678 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d2d8844e-facf-4ea1-8b46-b38103af33ce tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:49.006575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d2d8844e-facf-4ea1-8b46-b38103af33ce tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:49.007017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d2d8844e-facf-4ea1-8b46-b38103af33ce tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:49.007770 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d2d8844e-facf-4ea1-8b46-b38103af33ce tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:49.008201 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d2d8844e-facf-4ea1-8b46-b38103af33ce tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:49.268792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d2d8844e-facf-4ea1-8b46-b38103af33ce tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "POST /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.273943 May 23 10:56:49.269439 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 306/618] 10.222.0.36 () {62 vars in 1363 bytes} [Mon May 23 10:56:48 2022] POST /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/os-volume_attachments => generated 188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 10:56:49.380806 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-477f8874-0d3a-405a-96c2-efcdbe23216f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:49.381301 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-477f8874-0d3a-405a-96c2-efcdbe23216f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:49.387727 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-477f8874-0d3a-405a-96c2-efcdbe23216f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:49.388182 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-477f8874-0d3a-405a-96c2-efcdbe23216f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:49.388942 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-477f8874-0d3a-405a-96c2-efcdbe23216f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:49.389378 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-477f8874-0d3a-405a-96c2-efcdbe23216f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:49.634929 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-477f8874-0d3a-405a-96c2-efcdbe23216f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/os-volume_attachments/de59d567-8e78-48ed-b307-4ed69cd8534c" status: 202 len: 0 microversion: 2.20 time: 0.258615 May 23 10:56:49.637038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 313/619] 10.222.0.36 () {60 vars in 1456 bytes} [Mon May 23 10:56:49 2022] DELETE /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/os-volume_attachments/de59d567-8e78-48ed-b307-4ed69cd8534c => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 10:56:49.694205 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-76dce2e9-164a-4d13-a9c1-75927f85c7b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:49.694763 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-76dce2e9-164a-4d13-a9c1-75927f85c7b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:49.700728 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76dce2e9-164a-4d13-a9c1-75927f85c7b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:49.701171 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76dce2e9-164a-4d13-a9c1-75927f85c7b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:49.701923 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76dce2e9-164a-4d13-a9c1-75927f85c7b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:49.702386 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76dce2e9-164a-4d13-a9c1-75927f85c7b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:49.778399 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-76dce2e9-164a-4d13-a9c1-75927f85c7b3 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "POST /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/action" status: 202 len: 0 microversion: 2.20 time: 0.088019 May 23 10:56:49.779009 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 307/620] 10.222.0.36 () {62 vars in 1318 bytes} [Mon May 23 10:56:49 2022] POST /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 10:56:49.787906 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1f94b813-dccf-4563-bcab-b810903b40df tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:49.788509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1f94b813-dccf-4563-bcab-b810903b40df tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:49.794404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1f94b813-dccf-4563-bcab-b810903b40df tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:49.794854 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1f94b813-dccf-4563-bcab-b810903b40df tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:49.795615 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1f94b813-dccf-4563-bcab-b810903b40df tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:49.796133 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1f94b813-dccf-4563-bcab-b810903b40df tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:49.930231 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1f94b813-dccf-4563-bcab-b810903b40df tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:49.939039 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1f94b813-dccf-4563-bcab-b810903b40df tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:49.940538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1f94b813-dccf-4563-bcab-b810903b40df tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:49.941741 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1f94b813-dccf-4563-bcab-b810903b40df tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1673 microversion: 2.20 time: 0.158408 May 23 10:56:49.942328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 314/621] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:49 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:50.532724 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-826f08aa-6711-4518-9b88-f9b25546dc43 req-f8de2c1d-b09b-4adf-be50-473cf15f5646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde224c6-c41a-4424-8bc4-bd8f62d9fa53", "name": "network-vif-unplugged", "status": "completed", "tag": "40b35beb-6f47-44de-835b-56925cd7ae0f"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:56:50.541490 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-826f08aa-6711-4518-9b88-f9b25546dc43 req-f8de2c1d-b09b-4adf-be50-473cf15f5646 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:50.542231 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-826f08aa-6711-4518-9b88-f9b25546dc43 req-f8de2c1d-b09b-4adf-be50-473cf15f5646 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:50.554491 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.compute.server_external_events [req-826f08aa-6711-4518-9b88-f9b25546dc43 req-f8de2c1d-b09b-4adf-be50-473cf15f5646 service nova] Unable to find a host for instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53. Dropping event network-vif-unplugged {{(pid=129030) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 10:56:50.555439 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-826f08aa-6711-4518-9b88-f9b25546dc43 req-f8de2c1d-b09b-4adf-be50-473cf15f5646 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027363 May 23 10:56:50.556079 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 308/622] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 23 10:56:50.959856 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ed494dba-c1bb-4abe-b490-dd6f5ff88eff tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:50.960373 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ed494dba-c1bb-4abe-b490-dd6f5ff88eff tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:50.966811 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed494dba-c1bb-4abe-b490-dd6f5ff88eff tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:50.967269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed494dba-c1bb-4abe-b490-dd6f5ff88eff tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:50.968059 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed494dba-c1bb-4abe-b490-dd6f5ff88eff tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:50.968494 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ed494dba-c1bb-4abe-b490-dd6f5ff88eff tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:51.100739 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ed494dba-c1bb-4abe-b490-dd6f5ff88eff tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:51.108534 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ed494dba-c1bb-4abe-b490-dd6f5ff88eff tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:51.110048 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ed494dba-c1bb-4abe-b490-dd6f5ff88eff tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:51.111199 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ed494dba-c1bb-4abe-b490-dd6f5ff88eff tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.155294 May 23 10:56:51.111784 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 315/623] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:50 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:56:52.138638 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a2ba4368-ebef-4df4-ab37-b8e220ccc0f9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:52.141507 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a2ba4368-ebef-4df4-ab37-b8e220ccc0f9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:52.158714 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a2ba4368-ebef-4df4-ab37-b8e220ccc0f9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:52.160201 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a2ba4368-ebef-4df4-ab37-b8e220ccc0f9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:52.162463 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a2ba4368-ebef-4df4-ab37-b8e220ccc0f9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:52.163405 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a2ba4368-ebef-4df4-ab37-b8e220ccc0f9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:52.349327 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a2ba4368-ebef-4df4-ab37-b8e220ccc0f9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:52.358937 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a2ba4368-ebef-4df4-ab37-b8e220ccc0f9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:52.360432 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a2ba4368-ebef-4df4-ab37-b8e220ccc0f9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:52.362654 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a2ba4368-ebef-4df4-ab37-b8e220ccc0f9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.234876 May 23 10:56:52.363795 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 309/624] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:52 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:53.383407 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b2c94ee7-2048-4b42-baed-3e58d87b03d5 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:53.383964 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b2c94ee7-2048-4b42-baed-3e58d87b03d5 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:53.390431 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b2c94ee7-2048-4b42-baed-3e58d87b03d5 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:53.390884 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b2c94ee7-2048-4b42-baed-3e58d87b03d5 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:53.391666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b2c94ee7-2048-4b42-baed-3e58d87b03d5 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:53.392095 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b2c94ee7-2048-4b42-baed-3e58d87b03d5 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:53.532782 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b2c94ee7-2048-4b42-baed-3e58d87b03d5 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:53.540974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b2c94ee7-2048-4b42-baed-3e58d87b03d5 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:53.542520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b2c94ee7-2048-4b42-baed-3e58d87b03d5 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:53.543692 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b2c94ee7-2048-4b42-baed-3e58d87b03d5 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.165149 May 23 10:56:53.544252 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 316/625] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:53 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:54.561807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-28ce1676-4560-46b9-9e9a-8884847da160 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:54.563185 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-28ce1676-4560-46b9-9e9a-8884847da160 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:54.570326 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-28ce1676-4560-46b9-9e9a-8884847da160 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:54.570773 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-28ce1676-4560-46b9-9e9a-8884847da160 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:54.571680 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-28ce1676-4560-46b9-9e9a-8884847da160 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:54.572120 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-28ce1676-4560-46b9-9e9a-8884847da160 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:54.710052 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-28ce1676-4560-46b9-9e9a-8884847da160 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:54.718263 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-28ce1676-4560-46b9-9e9a-8884847da160 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:54.719774 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-28ce1676-4560-46b9-9e9a-8884847da160 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:54.720953 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-28ce1676-4560-46b9-9e9a-8884847da160 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.163012 May 23 10:56:54.721519 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 310/626] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:54 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:55.215423 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ef804669-f0e1-4299-9c2d-dcdce1c9e8c4 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:55.215976 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ef804669-f0e1-4299-9c2d-dcdce1c9e8c4 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:55.222862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ef804669-f0e1-4299-9c2d-dcdce1c9e8c4 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:55.223391 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ef804669-f0e1-4299-9c2d-dcdce1c9e8c4 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:55.224201 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ef804669-f0e1-4299-9c2d-dcdce1c9e8c4 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:55.224656 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ef804669-f0e1-4299-9c2d-dcdce1c9e8c4 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:55.327946 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-ef804669-f0e1-4299-9c2d-dcdce1c9e8c4 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lazy-loading 'services' on Instance uuid 67badd04-43b7-41f4-88fc-c7435ac2f158 {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:56:55.406859 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ef804669-f0e1-4299-9c2d-dcdce1c9e8c4 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments/945a19c9-9199-4d47-8561-68c14a3d7c18" status: 202 len: 0 microversion: 2.1 time: 0.195040 May 23 10:56:55.407720 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 317/627] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 10:56:55 2022] DELETE /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments/945a19c9-9199-4d47-8561-68c14a3d7c18 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:56:55.416230 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d52f47db-5c7e-4a1a-8bc8-04723fca3e13 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:55.418346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d52f47db-5c7e-4a1a-8bc8-04723fca3e13 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:55.425247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d52f47db-5c7e-4a1a-8bc8-04723fca3e13 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:55.426265 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d52f47db-5c7e-4a1a-8bc8-04723fca3e13 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:55.427047 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d52f47db-5c7e-4a1a-8bc8-04723fca3e13 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:55.427482 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d52f47db-5c7e-4a1a-8bc8-04723fca3e13 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:55.458326 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d52f47db-5c7e-4a1a-8bc8-04723fca3e13 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046016 May 23 10:56:55.462272 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 311/628] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:56:55 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:55.740834 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1e5e0a6a-893a-44a4-b60d-b04f2ad0fac0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:55.741547 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1e5e0a6a-893a-44a4-b60d-b04f2ad0fac0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:55.748099 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1e5e0a6a-893a-44a4-b60d-b04f2ad0fac0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:55.748550 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1e5e0a6a-893a-44a4-b60d-b04f2ad0fac0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:55.749332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1e5e0a6a-893a-44a4-b60d-b04f2ad0fac0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:55.749771 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1e5e0a6a-893a-44a4-b60d-b04f2ad0fac0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:55.892559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1e5e0a6a-893a-44a4-b60d-b04f2ad0fac0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:55.901859 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1e5e0a6a-893a-44a4-b60d-b04f2ad0fac0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:55.903447 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1e5e0a6a-893a-44a4-b60d-b04f2ad0fac0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:55.904625 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1e5e0a6a-893a-44a4-b60d-b04f2ad0fac0 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.168879 May 23 10:56:55.905220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 318/629] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:55 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:56.470192 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f23b9e79-181e-4d39-9192-46dbf6d52f05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:56.471148 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f23b9e79-181e-4d39-9192-46dbf6d52f05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:56.477720 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f23b9e79-181e-4d39-9192-46dbf6d52f05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:56.478197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f23b9e79-181e-4d39-9192-46dbf6d52f05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:56.478967 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f23b9e79-181e-4d39-9192-46dbf6d52f05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:56.479399 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f23b9e79-181e-4d39-9192-46dbf6d52f05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:56.510230 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f23b9e79-181e-4d39-9192-46dbf6d52f05 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044046 May 23 10:56:56.510954 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 312/630] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:56:56 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:56.924454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e720bf42-1669-49bb-a317-f4c7a69dedc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:56.925142 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e720bf42-1669-49bb-a317-f4c7a69dedc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:56.932476 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e720bf42-1669-49bb-a317-f4c7a69dedc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:56.932920 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e720bf42-1669-49bb-a317-f4c7a69dedc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:56.933688 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e720bf42-1669-49bb-a317-f4c7a69dedc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:56.934152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e720bf42-1669-49bb-a317-f4c7a69dedc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:57.066929 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e720bf42-1669-49bb-a317-f4c7a69dedc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:57.077323 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e720bf42-1669-49bb-a317-f4c7a69dedc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:57.078982 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e720bf42-1669-49bb-a317-f4c7a69dedc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:57.080220 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e720bf42-1669-49bb-a317-f4c7a69dedc6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.159774 May 23 10:56:57.080858 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 319/631] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:56 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:57.521760 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8b2acacc-b021-450c-bfc2-cdf062cd9eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:57.522952 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8b2acacc-b021-450c-bfc2-cdf062cd9eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:57.529278 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8b2acacc-b021-450c-bfc2-cdf062cd9eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:57.529800 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8b2acacc-b021-450c-bfc2-cdf062cd9eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:57.530632 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8b2acacc-b021-450c-bfc2-cdf062cd9eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:57.531065 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8b2acacc-b021-450c-bfc2-cdf062cd9eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:57.562260 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8b2acacc-b021-450c-bfc2-cdf062cd9eee tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 May 23 10:56:57.562828 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 313/632] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:56:57 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:58.099616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-dcb5c5ac-1e44-4eea-8451-967f4246ca97 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:58.100281 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-dcb5c5ac-1e44-4eea-8451-967f4246ca97 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:58.106835 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-dcb5c5ac-1e44-4eea-8451-967f4246ca97 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:58.107362 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-dcb5c5ac-1e44-4eea-8451-967f4246ca97 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:58.108269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-dcb5c5ac-1e44-4eea-8451-967f4246ca97 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:58.108837 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-dcb5c5ac-1e44-4eea-8451-967f4246ca97 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:58.286132 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-dcb5c5ac-1e44-4eea-8451-967f4246ca97 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:58.296687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-dcb5c5ac-1e44-4eea-8451-967f4246ca97 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:58.298222 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-dcb5c5ac-1e44-4eea-8451-967f4246ca97 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:58.299417 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-dcb5c5ac-1e44-4eea-8451-967f4246ca97 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.203793 May 23 10:56:58.299972 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 320/633] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:58 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:56:58.573757 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f72ca43c-054f-4b29-b1b0-ccce0565eb8d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:58.575543 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f72ca43c-054f-4b29-b1b0-ccce0565eb8d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:58.583061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f72ca43c-054f-4b29-b1b0-ccce0565eb8d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:58.583508 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f72ca43c-054f-4b29-b1b0-ccce0565eb8d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:58.584282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f72ca43c-054f-4b29-b1b0-ccce0565eb8d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:58.584717 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f72ca43c-054f-4b29-b1b0-ccce0565eb8d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:58.628805 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f72ca43c-054f-4b29-b1b0-ccce0565eb8d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058844 May 23 10:56:58.629605 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 314/634] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:56:58 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:56:59.319111 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fd133f38-7a5d-403f-8fe2-d5d3287f953a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:59.319737 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-fd133f38-7a5d-403f-8fe2-d5d3287f953a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:59.326680 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fd133f38-7a5d-403f-8fe2-d5d3287f953a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:59.327163 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fd133f38-7a5d-403f-8fe2-d5d3287f953a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:59.327935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fd133f38-7a5d-403f-8fe2-d5d3287f953a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:59.328373 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fd133f38-7a5d-403f-8fe2-d5d3287f953a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:59.333301 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:59.467657 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fd133f38-7a5d-403f-8fe2-d5d3287f953a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:59.475888 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fd133f38-7a5d-403f-8fe2-d5d3287f953a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:59.477326 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fd133f38-7a5d-403f-8fe2-d5d3287f953a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:56:59.478528 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fd133f38-7a5d-403f-8fe2-d5d3287f953a tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.163857 May 23 10:56:59.479276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 321/635] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:56:59 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:56:59.641657 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-01b93110-fcd3-4015-889e-3c03bed8995e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:56:59.642607 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-01b93110-fcd3-4015-889e-3c03bed8995e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:56:59.649917 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-01b93110-fcd3-4015-889e-3c03bed8995e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:59.650443 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-01b93110-fcd3-4015-889e-3c03bed8995e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:59.662182 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-01b93110-fcd3-4015-889e-3c03bed8995e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:56:59.662182 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-01b93110-fcd3-4015-889e-3c03bed8995e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:56:59.674942 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:56:59.686841 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-01b93110-fcd3-4015-889e-3c03bed8995e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049144 May 23 10:56:59.691509 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 315/636] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:56:59 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:00.496511 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-99a05130-186d-46e9-aad1-70e354c4aa65 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:00.497124 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-99a05130-186d-46e9-aad1-70e354c4aa65 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:00.503646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99a05130-186d-46e9-aad1-70e354c4aa65 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:00.504101 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99a05130-186d-46e9-aad1-70e354c4aa65 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:00.504869 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99a05130-186d-46e9-aad1-70e354c4aa65 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:00.505310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99a05130-186d-46e9-aad1-70e354c4aa65 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:00.630762 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-99a05130-186d-46e9-aad1-70e354c4aa65 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:00.638598 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-99a05130-186d-46e9-aad1-70e354c4aa65 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:00.640108 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-99a05130-186d-46e9-aad1-70e354c4aa65 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:00.641275 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-99a05130-186d-46e9-aad1-70e354c4aa65 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.148664 May 23 10:57:00.641825 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 322/637] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:00 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:57:00.698210 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e8a7397f-ac98-461a-8e13-4aa7ede67f90 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:00.699123 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e8a7397f-ac98-461a-8e13-4aa7ede67f90 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:00.707220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8a7397f-ac98-461a-8e13-4aa7ede67f90 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:00.707678 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8a7397f-ac98-461a-8e13-4aa7ede67f90 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:00.708442 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8a7397f-ac98-461a-8e13-4aa7ede67f90 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:00.708878 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8a7397f-ac98-461a-8e13-4aa7ede67f90 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:00.737452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e8a7397f-ac98-461a-8e13-4aa7ede67f90 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 May 23 10:57:00.738114 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 316/638] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:00 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:01.660320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-506202a6-6e34-4f6c-bb9f-fa4f28392987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:01.660922 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-506202a6-6e34-4f6c-bb9f-fa4f28392987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:01.667391 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-506202a6-6e34-4f6c-bb9f-fa4f28392987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:01.667835 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-506202a6-6e34-4f6c-bb9f-fa4f28392987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:01.668591 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-506202a6-6e34-4f6c-bb9f-fa4f28392987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:01.669024 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-506202a6-6e34-4f6c-bb9f-fa4f28392987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:01.748829 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9a27a313-0e7f-46cb-acf5-c8d9d5e7565d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:01.749754 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9a27a313-0e7f-46cb-acf5-c8d9d5e7565d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:01.756211 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9a27a313-0e7f-46cb-acf5-c8d9d5e7565d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:01.756666 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9a27a313-0e7f-46cb-acf5-c8d9d5e7565d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:01.757437 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9a27a313-0e7f-46cb-acf5-c8d9d5e7565d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:01.757878 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9a27a313-0e7f-46cb-acf5-c8d9d5e7565d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:01.787142 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9a27a313-0e7f-46cb-acf5-c8d9d5e7565d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042264 May 23 10:57:01.787922 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 317/639] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:01 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:57:01.798499 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-506202a6-6e34-4f6c-bb9f-fa4f28392987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:01.806935 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-506202a6-6e34-4f6c-bb9f-fa4f28392987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:01.808450 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-506202a6-6e34-4f6c-bb9f-fa4f28392987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:01.809583 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-506202a6-6e34-4f6c-bb9f-fa4f28392987 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.153647 May 23 10:57:01.810163 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 323/640] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:01 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:57:02.798623 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-911a092f-1488-4819-9dd5-2231a663f85d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:02.799617 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-911a092f-1488-4819-9dd5-2231a663f85d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:02.806763 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-911a092f-1488-4819-9dd5-2231a663f85d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:02.807218 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-911a092f-1488-4819-9dd5-2231a663f85d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:02.807982 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-911a092f-1488-4819-9dd5-2231a663f85d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:02.808419 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-911a092f-1488-4819-9dd5-2231a663f85d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:02.827463 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2fe4f1bb-42c7-43b2-9b25-cd9a4c6db2af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:02.828019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2fe4f1bb-42c7-43b2-9b25-cd9a4c6db2af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:02.834389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2fe4f1bb-42c7-43b2-9b25-cd9a4c6db2af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:02.834833 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2fe4f1bb-42c7-43b2-9b25-cd9a4c6db2af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:02.835588 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2fe4f1bb-42c7-43b2-9b25-cd9a4c6db2af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:02.836019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2fe4f1bb-42c7-43b2-9b25-cd9a4c6db2af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:02.837858 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-911a092f-1488-4819-9dd5-2231a663f85d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 May 23 10:57:02.838658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 318/641] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:02 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:02.961096 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2fe4f1bb-42c7-43b2-9b25-cd9a4c6db2af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:02.968806 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2fe4f1bb-42c7-43b2-9b25-cd9a4c6db2af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:02.970581 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2fe4f1bb-42c7-43b2-9b25-cd9a4c6db2af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:02.971719 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2fe4f1bb-42c7-43b2-9b25-cd9a4c6db2af tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.148152 May 23 10:57:02.972799 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 324/642] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:02 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:57:03.550809 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-748c12cf-5d56-472f-a1e8-196c6495b30e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:03.551732 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-748c12cf-5d56-472f-a1e8-196c6495b30e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:03.557786 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-748c12cf-5d56-472f-a1e8-196c6495b30e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:03.558274 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-748c12cf-5d56-472f-a1e8-196c6495b30e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:03.559045 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-748c12cf-5d56-472f-a1e8-196c6495b30e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:03.559486 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-748c12cf-5d56-472f-a1e8-196c6495b30e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:03.588152 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-748c12cf-5d56-472f-a1e8-196c6495b30e tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 May 23 10:57:03.588708 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 319/643] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:03 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:03.599007 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d118cffc-ade2-45d6-8520-2c7d17c16526 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:03.599490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d118cffc-ade2-45d6-8520-2c7d17c16526 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:03.605478 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d118cffc-ade2-45d6-8520-2c7d17c16526 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:03.605926 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d118cffc-ade2-45d6-8520-2c7d17c16526 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:03.606714 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d118cffc-ade2-45d6-8520-2c7d17c16526 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:03.607147 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d118cffc-ade2-45d6-8520-2c7d17c16526 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:03.634538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d118cffc-ade2-45d6-8520-2c7d17c16526 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments/0c3e3d57-7172-4d20-915e-f480b88f3a97" status: 200 len: 194 microversion: 2.1 time: 0.040046 May 23 10:57:03.635098 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 325/644] 10.222.0.36 () {58 vars in 1412 bytes} [Mon May 23 10:57:03 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments/0c3e3d57-7172-4d20-915e-f480b88f3a97 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:03.849556 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7d2b76df-edf8-4ffc-8c63-78458f7e681f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:03.850401 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-7d2b76df-edf8-4ffc-8c63-78458f7e681f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:03.857328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d2b76df-edf8-4ffc-8c63-78458f7e681f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:03.858105 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d2b76df-edf8-4ffc-8c63-78458f7e681f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:03.859317 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d2b76df-edf8-4ffc-8c63-78458f7e681f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:03.859954 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d2b76df-edf8-4ffc-8c63-78458f7e681f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:03.890947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-7d2b76df-edf8-4ffc-8c63-78458f7e681f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045914 May 23 10:57:03.891710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 320/645] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:03 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 10:57:03.966036 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6a5f0b07-92f6-4edd-b8bb-2f01ec1f37ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:03.966555 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6a5f0b07-92f6-4edd-b8bb-2f01ec1f37ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:03.972814 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6a5f0b07-92f6-4edd-b8bb-2f01ec1f37ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:03.973258 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6a5f0b07-92f6-4edd-b8bb-2f01ec1f37ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:03.974033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6a5f0b07-92f6-4edd-b8bb-2f01ec1f37ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:03.974469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6a5f0b07-92f6-4edd-b8bb-2f01ec1f37ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:03.990074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-773c2dc0-aef6-438c-95cd-09155e483563 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:03.990793 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-773c2dc0-aef6-438c-95cd-09155e483563 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:03.996813 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-773c2dc0-aef6-438c-95cd-09155e483563 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:03.997264 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-773c2dc0-aef6-438c-95cd-09155e483563 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:03.998054 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-773c2dc0-aef6-438c-95cd-09155e483563 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:03.998498 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-773c2dc0-aef6-438c-95cd-09155e483563 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:03.998610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6a5f0b07-92f6-4edd-b8bb-2f01ec1f37ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:57:04.079253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6a5f0b07-92f6-4edd-b8bb-2f01ec1f37ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 204 len: 0 microversion: 2.1 time: 0.116560 May 23 10:57:04.079997 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 326/646] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:03 2022] DELETE /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:57:04.089835 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9c601e6c-a2df-42c1-a4b2-b864df9ce6e6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:04.090558 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9c601e6c-a2df-42c1-a4b2-b864df9ce6e6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:04.096648 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9c601e6c-a2df-42c1-a4b2-b864df9ce6e6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:04.097716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9c601e6c-a2df-42c1-a4b2-b864df9ce6e6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:04.098544 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9c601e6c-a2df-42c1-a4b2-b864df9ce6e6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:04.099594 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9c601e6c-a2df-42c1-a4b2-b864df9ce6e6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:04.132201 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-773c2dc0-aef6-438c-95cd-09155e483563 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:04.144959 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-773c2dc0-aef6-438c-95cd-09155e483563 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:04.147201 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-773c2dc0-aef6-438c-95cd-09155e483563 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:04.148394 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-773c2dc0-aef6-438c-95cd-09155e483563 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.162848 May 23 10:57:04.148961 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 321/647] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:03 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:57:04.235426 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9c601e6c-a2df-42c1-a4b2-b864df9ce6e6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:04.243760 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9c601e6c-a2df-42c1-a4b2-b864df9ce6e6 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1689 microversion: 2.1 time: 0.158730 May 23 10:57:04.244173 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 327/648] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:04 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:57:04.944341 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-96149f30-4cb6-420a-b80f-fe0b5a3d9800 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7282b71e-2981-4e3d-99b4-cdc4f59e56fd"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:04.945430 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-96149f30-4cb6-420a-b80f-fe0b5a3d9800 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:04.952055 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-96149f30-4cb6-420a-b80f-fe0b5a3d9800 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:04.952500 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-96149f30-4cb6-420a-b80f-fe0b5a3d9800 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:04.953262 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-96149f30-4cb6-420a-b80f-fe0b5a3d9800 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:04.953727 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-96149f30-4cb6-420a-b80f-fe0b5a3d9800 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:05.166843 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cc5ec365-a11d-4d8a-b6a5-25cd7b270101 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:05.167515 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-cc5ec365-a11d-4d8a-b6a5-25cd7b270101 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:05.173958 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cc5ec365-a11d-4d8a-b6a5-25cd7b270101 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:05.174431 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cc5ec365-a11d-4d8a-b6a5-25cd7b270101 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:05.175707 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cc5ec365-a11d-4d8a-b6a5-25cd7b270101 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:05.176146 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cc5ec365-a11d-4d8a-b6a5-25cd7b270101 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:05.302218 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-cc5ec365-a11d-4d8a-b6a5-25cd7b270101 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:05.310199 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-cc5ec365-a11d-4d8a-b6a5-25cd7b270101 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:05.311687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-cc5ec365-a11d-4d8a-b6a5-25cd7b270101 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:05.312836 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-cc5ec365-a11d-4d8a-b6a5-25cd7b270101 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.150002 May 23 10:57:05.313390 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 328/649] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:05 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:57:05.317867 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fbf96789-4027-484a-ab39-6a6d4e49cd0d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:05.318488 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-fbf96789-4027-484a-ab39-6a6d4e49cd0d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:05.324019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fbf96789-4027-484a-ab39-6a6d4e49cd0d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:05.324459 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fbf96789-4027-484a-ab39-6a6d4e49cd0d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:05.325205 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fbf96789-4027-484a-ab39-6a6d4e49cd0d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:05.325635 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fbf96789-4027-484a-ab39-6a6d4e49cd0d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:05.448831 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fbf96789-4027-484a-ab39-6a6d4e49cd0d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:05.456174 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fbf96789-4027-484a-ab39-6a6d4e49cd0d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1689 microversion: 2.1 time: 0.141854 May 23 10:57:05.456739 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 329/650] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:05 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1689 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:06.331080 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-25fc5277-79e6-48a1-8d2e-adc6adf4811f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:06.332318 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-25fc5277-79e6-48a1-8d2e-adc6adf4811f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:06.338794 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-25fc5277-79e6-48a1-8d2e-adc6adf4811f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:06.339244 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-25fc5277-79e6-48a1-8d2e-adc6adf4811f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:06.340013 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-25fc5277-79e6-48a1-8d2e-adc6adf4811f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:06.340443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-25fc5277-79e6-48a1-8d2e-adc6adf4811f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:06.469324 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-25fc5277-79e6-48a1-8d2e-adc6adf4811f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:06.477350 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-25fc5277-79e6-48a1-8d2e-adc6adf4811f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:06.478874 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-25fc5277-79e6-48a1-8d2e-adc6adf4811f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:06.480024 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-25fc5277-79e6-48a1-8d2e-adc6adf4811f tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.152950 May 23 10:57:06.480587 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 330/651] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:06 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:57:06.484901 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e67d5268-b526-41b4-85d3-27882019994e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:06.485499 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e67d5268-b526-41b4-85d3-27882019994e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:06.491495 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e67d5268-b526-41b4-85d3-27882019994e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:06.491940 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e67d5268-b526-41b4-85d3-27882019994e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:06.492694 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e67d5268-b526-41b4-85d3-27882019994e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:06.493128 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e67d5268-b526-41b4-85d3-27882019994e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:06.620369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e67d5268-b526-41b4-85d3-27882019994e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:06.627793 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e67d5268-b526-41b4-85d3-27882019994e tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1689 microversion: 2.1 time: 0.146261 May 23 10:57:06.628955 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 331/652] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:06 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:06.668967 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-9df1628c-d09e-415a-8f24-c8bfda5a8beb req-efae09f1-475c-48e5-bf06-691e05f3a4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde224c6-c41a-4424-8bc4-bd8f62d9fa53", "name": "network-vif-plugged", "status": "completed", "tag": "40b35beb-6f47-44de-835b-56925cd7ae0f"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:06.678335 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-9df1628c-d09e-415a-8f24-c8bfda5a8beb req-efae09f1-475c-48e5-bf06-691e05f3a4a9 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:06.678765 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-9df1628c-d09e-415a-8f24-c8bfda5a8beb req-efae09f1-475c-48e5-bf06-691e05f3a4a9 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:06.692001 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-9df1628c-d09e-415a-8f24-c8bfda5a8beb req-efae09f1-475c-48e5-bf06-691e05f3a4a9 service nova] Creating event network-vif-plugged:40b35beb-6f47-44de-835b-56925cd7ae0f for instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 on hv-cinder-83699 May 23 10:57:06.697002 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-9df1628c-d09e-415a-8f24-c8bfda5a8beb req-efae09f1-475c-48e5-bf06-691e05f3a4a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031586 May 23 10:57:06.697585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 332/653] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:57:07.499890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a8585a9c-1805-4918-ba61-3f14dc11b3a7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:07.500981 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a8585a9c-1805-4918-ba61-3f14dc11b3a7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:07.509489 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8585a9c-1805-4918-ba61-3f14dc11b3a7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:07.510522 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8585a9c-1805-4918-ba61-3f14dc11b3a7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:07.511576 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8585a9c-1805-4918-ba61-3f14dc11b3a7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:07.512036 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8585a9c-1805-4918-ba61-3f14dc11b3a7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:07.642275 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a8585a9c-1805-4918-ba61-3f14dc11b3a7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:07.651001 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a8585a9c-1805-4918-ba61-3f14dc11b3a7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:07.652476 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a8585a9c-1805-4918-ba61-3f14dc11b3a7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:07.653617 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a8585a9c-1805-4918-ba61-3f14dc11b3a7 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.158545 May 23 10:57:07.654203 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 333/654] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:07 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:57:07.658454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-502a6c41-c2d1-403d-b19b-0366dc6aad5d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:07.659069 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-502a6c41-c2d1-403d-b19b-0366dc6aad5d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:07.664810 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-502a6c41-c2d1-403d-b19b-0366dc6aad5d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:07.665258 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-502a6c41-c2d1-403d-b19b-0366dc6aad5d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:07.666042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-502a6c41-c2d1-403d-b19b-0366dc6aad5d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:07.666478 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-502a6c41-c2d1-403d-b19b-0366dc6aad5d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:07.799169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-96149f30-4cb6-420a-b80f-fe0b5a3d9800 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "POST /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.859294 May 23 10:57:07.800394 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 322/655] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:57:04 2022] POST /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments => generated 194 bytes in 2861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:07.807409 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-502a6c41-c2d1-403d-b19b-0366dc6aad5d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:07.815123 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-502a6c41-c2d1-403d-b19b-0366dc6aad5d tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1689 microversion: 2.1 time: 0.159964 May 23 10:57:07.816314 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 334/656] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:07 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:08.673798 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-aa96b775-59b0-4fd3-b125-b51414313a91 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:08.674521 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-aa96b775-59b0-4fd3-b125-b51414313a91 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:08.681012 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aa96b775-59b0-4fd3-b125-b51414313a91 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:08.681467 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aa96b775-59b0-4fd3-b125-b51414313a91 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:08.682314 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aa96b775-59b0-4fd3-b125-b51414313a91 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:08.682746 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aa96b775-59b0-4fd3-b125-b51414313a91 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:08.742930 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-1b497152-44f2-4e1b-a1c3-9bdf5ad04f47 req-ce50c60a-7604-4d21-8cd2-d9a994bd173c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67badd04-43b7-41f4-88fc-c7435ac2f158", "name": "network-vif-deleted", "tag": "9da49a79-8d41-4702-8f35-b66bc046212c"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:08.751453 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-1b497152-44f2-4e1b-a1c3-9bdf5ad04f47 req-ce50c60a-7604-4d21-8cd2-d9a994bd173c service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:08.751993 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-1b497152-44f2-4e1b-a1c3-9bdf5ad04f47 req-ce50c60a-7604-4d21-8cd2-d9a994bd173c service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:08.763331 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-1b497152-44f2-4e1b-a1c3-9bdf5ad04f47 req-ce50c60a-7604-4d21-8cd2-d9a994bd173c service nova] Creating event network-vif-deleted:9da49a79-8d41-4702-8f35-b66bc046212c for instance 67badd04-43b7-41f4-88fc-c7435ac2f158 on hv-cinder-83699 May 23 10:57:08.768371 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-1b497152-44f2-4e1b-a1c3-9bdf5ad04f47 req-ce50c60a-7604-4d21-8cd2-d9a994bd173c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028950 May 23 10:57:08.769618 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 335/657] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:08.834051 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-604f7ce7-db95-41aa-9282-bfb6c3812b91 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:08.834609 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-604f7ce7-db95-41aa-9282-bfb6c3812b91 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:08.841308 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-604f7ce7-db95-41aa-9282-bfb6c3812b91 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:08.842148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-604f7ce7-db95-41aa-9282-bfb6c3812b91 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:08.843172 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-604f7ce7-db95-41aa-9282-bfb6c3812b91 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:08.843925 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-604f7ce7-db95-41aa-9282-bfb6c3812b91 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:08.847882 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aa96b775-59b0-4fd3-b125-b51414313a91 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:08.860085 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aa96b775-59b0-4fd3-b125-b51414313a91 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:08.862072 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aa96b775-59b0-4fd3-b125-b51414313a91 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:08.863994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-aa96b775-59b0-4fd3-b125-b51414313a91 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.194987 May 23 10:57:08.865564 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 323/658] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:08 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:57:08.935093 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-604f7ce7-db95-41aa-9282-bfb6c3812b91 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:08.944262 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-604f7ce7-db95-41aa-9282-bfb6c3812b91 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1621 microversion: 2.1 time: 0.115077 May 23 10:57:08.954536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 336/659] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:08 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1621 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:57:09.884057 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7d166c53-1526-4f45-ab02-957077b28dd9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:09.884661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-7d166c53-1526-4f45-ab02-957077b28dd9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:09.891270 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d166c53-1526-4f45-ab02-957077b28dd9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:09.891719 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d166c53-1526-4f45-ab02-957077b28dd9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:09.892479 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d166c53-1526-4f45-ab02-957077b28dd9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:09.892909 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7d166c53-1526-4f45-ab02-957077b28dd9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:09.962483 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:09.963088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:09.969756 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:09.970557 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:09.971835 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:09.972503 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:09.992689 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:10.009482 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:10.010498 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:10.010968 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lazy-loading 'fault' on Instance uuid 67badd04-43b7-41f4-88fc-c7435ac2f158 {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:57:10.033734 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-7d166c53-1526-4f45-ab02-957077b28dd9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:10.042005 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-7d166c53-1526-4f45-ab02-957077b28dd9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:10.043498 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-7d166c53-1526-4f45-ab02-957077b28dd9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:10.044655 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-7d166c53-1526-4f45-ab02-957077b28dd9 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1731 microversion: 2.20 time: 0.164648 May 23 10:57:10.045211 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 324/660] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:09 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:57:10.070567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:10.079044 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a47871ec-54f4-4a78-8c6e-9441dc8358ff tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 200 len: 1336 microversion: 2.1 time: 0.120391 May 23 10:57:10.079617 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 337/661] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:09 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:57:11.064322 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d9f0ea05-6a28-4260-a318-4381b6d2cfb6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:11.066078 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d9f0ea05-6a28-4260-a318-4381b6d2cfb6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:11.074232 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d9f0ea05-6a28-4260-a318-4381b6d2cfb6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.074687 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d9f0ea05-6a28-4260-a318-4381b6d2cfb6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.076109 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d9f0ea05-6a28-4260-a318-4381b6d2cfb6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.077061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d9f0ea05-6a28-4260-a318-4381b6d2cfb6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.097464 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-284182f0-f04e-4bb4-982d-289380e39454 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:11.098415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-284182f0-f04e-4bb4-982d-289380e39454 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: 67badd04-43b7-41f4-88fc-c7435ac2f158] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:11.105255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-284182f0-f04e-4bb4-982d-289380e39454 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.105795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-284182f0-f04e-4bb4-982d-289380e39454 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.106748 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-284182f0-f04e-4bb4-982d-289380e39454 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.107516 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-284182f0-f04e-4bb4-982d-289380e39454 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.121626 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-284182f0-f04e-4bb4-982d-289380e39454 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] HTTP exception thrown: Instance 67badd04-43b7-41f4-88fc-c7435ac2f158 could not be found. May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-284182f0-f04e-4bb4-982d-289380e39454 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Request method failure captured: May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 HTTP/1.1 May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2eLhnLJl1WQHI6AQhbejgYPFTmHkdxSbb8YGQPU-jfMtBrmgOgTu6SnJpnxYF42UIG9Y970L_Xtfbn7Z694Bj4Sxalc3YSV73HRTz_zeRlmCwMmhl_7B5-C6bxvl_9ZZJTQqwCn8HXEekRlTd41SnLC_JFnHqfCQzK0qmyt8KWdAzI May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 33781de828264846b90b5cbbbeee7fe5 May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:11.123745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33781de828264846b90b5cbbbeee7fe5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 33781de828264846b90b5cbbbeee7fe5 May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-ServerRescueNegativeTestJSON-485230613-project May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 06f644c1c44d4dafacbd5bbdde323ff0 May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-ServerRescueNegativeTestJSON-485230613-project May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 67badd04-43b7-41f4-88fc-c7435ac2f158 could not be found. May 23 10:57:11.125295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '67badd04-43b7-41f4-88fc-c7435ac2f158'} May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67badd04-43b7-41f4-88fc-c7435ac2f158 could not be found. May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:11.126194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67badd04-43b7-41f4-88fc-c7435ac2f158 could not be found. May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67badd04-43b7-41f4-88fc-c7435ac2f158 could not be found. May 23 10:57:11.127659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:11.129807 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-284182f0-f04e-4bb4-982d-289380e39454 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Returning 404 to user: Instance 67badd04-43b7-41f4-88fc-c7435ac2f158 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:11.129807 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-284182f0-f04e-4bb4-982d-289380e39454 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158" status: 404 len: 111 microversion: 2.1 time: 0.032629 May 23 10:57:11.129807 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 338/662] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:11 2022] GET /compute/v2.1/servers/67badd04-43b7-41f4-88fc-c7435ac2f158 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:11.134435 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-378d4978-40c7-4e62-a2cd-0e52275906ba tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '.version_select at 0x7fe720066310>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:11.155190 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-378d4978-40c7-4e62-a2cd-0e52275906ba tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362548933" status: 202 len: 0 microversion: 2.1 time: 0.023304 May 23 10:57:11.155190 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 339/663] 10.222.0.36 () {58 vars in 1220 bytes} [Mon May 23 10:57:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362548933 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:57:11.163141 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d979ce70-7681-4098-ac07-7adf819354d3 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:11.163513 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d979ce70-7681-4098-ac07-7adf819354d3 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:11.170252 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d979ce70-7681-4098-ac07-7adf819354d3 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.170706 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d979ce70-7681-4098-ac07-7adf819354d3 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.171492 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d979ce70-7681-4098-ac07-7adf819354d3 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.171934 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d979ce70-7681-4098-ac07-7adf819354d3 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.202839 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d979ce70-7681-4098-ac07-7adf819354d3 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044330 May 23 10:57:11.203640 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 340/664] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:11 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:11.232273 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d9f0ea05-6a28-4260-a318-4381b6d2cfb6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:11.242947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d9f0ea05-6a28-4260-a318-4381b6d2cfb6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:11.244779 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d9f0ea05-6a28-4260-a318-4381b6d2cfb6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:11.245599 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d9f0ea05-6a28-4260-a318-4381b6d2cfb6 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1718 microversion: 2.20 time: 0.185972 May 23 10:57:11.246188 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 325/665] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:11 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1718 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:57:11.345579 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-951d2d86-286f-46cf-b988-28c86768502a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:11.346120 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-951d2d86-286f-46cf-b988-28c86768502a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:11.353487 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-951d2d86-286f-46cf-b988-28c86768502a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.354186 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-951d2d86-286f-46cf-b988-28c86768502a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.355067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-951d2d86-286f-46cf-b988-28c86768502a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.355516 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-951d2d86-286f-46cf-b988-28c86768502a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.384625 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-951d2d86-286f-46cf-b988-28c86768502a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments/0c3e3d57-7172-4d20-915e-f480b88f3a97" status: 200 len: 194 microversion: 2.1 time: 0.043909 May 23 10:57:11.385211 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 341/666] 10.222.0.36 () {58 vars in 1412 bytes} [Mon May 23 10:57:11 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments/0c3e3d57-7172-4d20-915e-f480b88f3a97 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:11.396095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a8973b68-717f-4a82-b101-54e968e5964f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:11.397363 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a8973b68-717f-4a82-b101-54e968e5964f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:11.403499 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a8973b68-717f-4a82-b101-54e968e5964f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.404015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a8973b68-717f-4a82-b101-54e968e5964f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.404854 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a8973b68-717f-4a82-b101-54e968e5964f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.405375 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a8973b68-717f-4a82-b101-54e968e5964f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.496208 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-a8973b68-717f-4a82-b101-54e968e5964f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lazy-loading 'services' on Instance uuid c331e053-3f7e-42c9-9f4e-4601f4aa98f9 {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:57:11.569554 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a8973b68-717f-4a82-b101-54e968e5964f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments/0c3e3d57-7172-4d20-915e-f480b88f3a97" status: 202 len: 0 microversion: 2.1 time: 0.178321 May 23 10:57:11.585552 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 326/667] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 10:57:11 2022] DELETE /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments/0c3e3d57-7172-4d20-915e-f480b88f3a97 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 10:57:11.670776 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-99ad8873-41d5-4e8e-b62c-b9c61b549629 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:11.671286 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-99ad8873-41d5-4e8e-b62c-b9c61b549629 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:11.678293 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99ad8873-41d5-4e8e-b62c-b9c61b549629 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.678900 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99ad8873-41d5-4e8e-b62c-b9c61b549629 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.679777 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99ad8873-41d5-4e8e-b62c-b9c61b549629 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:11.680531 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99ad8873-41d5-4e8e-b62c-b9c61b549629 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:11.706581 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-99ad8873-41d5-4e8e-b62c-b9c61b549629 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/ips" status: 200 len: 149 microversion: 2.1 time: 0.116401 May 23 10:57:11.707358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 342/668] 10.222.0.36 () {58 vars in 1247 bytes} [Mon May 23 10:57:11 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/ips => generated 149 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:13.036454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5d639307-35aa-4c94-96f1-fe31c54e9ca4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdd82ee8-3cbf-4f69-acbf-e7c875eb61a1"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:13.037680 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5d639307-35aa-4c94-96f1-fe31c54e9ca4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:13.039753 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=52 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:13.045297 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5d639307-35aa-4c94-96f1-fe31c54e9ca4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:13.045741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5d639307-35aa-4c94-96f1-fe31c54e9ca4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:13.046528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5d639307-35aa-4c94-96f1-fe31c54e9ca4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:13.046962 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5d639307-35aa-4c94-96f1-fe31c54e9ca4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:13.304641 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5d639307-35aa-4c94-96f1-fe31c54e9ca4 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "POST /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273312 May 23 10:57:13.305274 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 327/669] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 10:57:13 2022] POST /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:13.746899 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b608a47c-9232-464f-8133-0ca7a0400af6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:13.747391 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b608a47c-9232-464f-8133-0ca7a0400af6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:13.749768 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:13.755513 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b608a47c-9232-464f-8133-0ca7a0400af6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:13.755961 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b608a47c-9232-464f-8133-0ca7a0400af6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:13.756721 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b608a47c-9232-464f-8133-0ca7a0400af6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:13.757154 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b608a47c-9232-464f-8133-0ca7a0400af6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:13.786499 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b608a47c-9232-464f-8133-0ca7a0400af6 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments/7282b71e-2981-4e3d-99b4-cdc4f59e56fd" status: 200 len: 194 microversion: 2.1 time: 0.043494 May 23 10:57:13.787085 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 343/670] 10.222.0.36 () {58 vars in 1412 bytes} [Mon May 23 10:57:13 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments/7282b71e-2981-4e3d-99b4-cdc4f59e56fd => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:13.797974 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5f27d249-53dc-4a21-b565-01ea5b096ac4 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:13.798580 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5f27d249-53dc-4a21-b565-01ea5b096ac4 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:13.804803 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5f27d249-53dc-4a21-b565-01ea5b096ac4 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:13.805261 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5f27d249-53dc-4a21-b565-01ea5b096ac4 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:13.806058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5f27d249-53dc-4a21-b565-01ea5b096ac4 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:13.806498 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5f27d249-53dc-4a21-b565-01ea5b096ac4 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:13.823906 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:13.890030 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-5f27d249-53dc-4a21-b565-01ea5b096ac4 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lazy-loading 'services' on Instance uuid c331e053-3f7e-42c9-9f4e-4601f4aa98f9 {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:57:13.963215 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5f27d249-53dc-4a21-b565-01ea5b096ac4 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments/7282b71e-2981-4e3d-99b4-cdc4f59e56fd" status: 202 len: 0 microversion: 2.1 time: 0.170036 May 23 10:57:13.963799 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 328/671] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 10:57:13 2022] DELETE /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments/7282b71e-2981-4e3d-99b4-cdc4f59e56fd => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:57:14.041274 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-94b2e5d5-e717-44dc-b438-9def6813449c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:14.041752 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-94b2e5d5-e717-44dc-b438-9def6813449c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:14.047738 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-94b2e5d5-e717-44dc-b438-9def6813449c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:14.048191 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-94b2e5d5-e717-44dc-b438-9def6813449c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:14.048955 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-94b2e5d5-e717-44dc-b438-9def6813449c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:14.049397 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-94b2e5d5-e717-44dc-b438-9def6813449c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:14.077042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-94b2e5d5-e717-44dc-b438-9def6813449c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:57:14.151576 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-94b2e5d5-e717-44dc-b438-9def6813449c tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 204 len: 0 microversion: 2.1 time: 0.113868 May 23 10:57:14.152324 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 344/672] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:14 2022] DELETE /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:57:14.161320 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-626fcb8a-b45e-476f-8345-ad3204e9d200 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:14.162049 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-626fcb8a-b45e-476f-8345-ad3204e9d200 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:14.168417 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-626fcb8a-b45e-476f-8345-ad3204e9d200 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:14.168868 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-626fcb8a-b45e-476f-8345-ad3204e9d200 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:14.169640 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-626fcb8a-b45e-476f-8345-ad3204e9d200 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:14.170116 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-626fcb8a-b45e-476f-8345-ad3204e9d200 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:14.299650 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-626fcb8a-b45e-476f-8345-ad3204e9d200 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:14.307787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-626fcb8a-b45e-476f-8345-ad3204e9d200 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1506 microversion: 2.1 time: 0.151209 May 23 10:57:14.308351 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 329/673] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:14 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:15.325313 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6f215398-5faa-43a9-af17-05caf397b07a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:15.326022 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6f215398-5faa-43a9-af17-05caf397b07a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:15.332997 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f215398-5faa-43a9-af17-05caf397b07a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:15.333436 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f215398-5faa-43a9-af17-05caf397b07a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:15.334216 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f215398-5faa-43a9-af17-05caf397b07a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:15.334648 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6f215398-5faa-43a9-af17-05caf397b07a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:15.461774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6f215398-5faa-43a9-af17-05caf397b07a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:15.469377 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6f215398-5faa-43a9-af17-05caf397b07a tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1506 microversion: 2.1 time: 0.148222 May 23 10:57:15.470027 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 345/674] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:15 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:16.486325 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c4ee99f9-4426-4d7c-93a6-f67bd2826930 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:16.486937 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c4ee99f9-4426-4d7c-93a6-f67bd2826930 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:16.494126 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4ee99f9-4426-4d7c-93a6-f67bd2826930 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:16.494576 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4ee99f9-4426-4d7c-93a6-f67bd2826930 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:16.495347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4ee99f9-4426-4d7c-93a6-f67bd2826930 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:16.495782 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c4ee99f9-4426-4d7c-93a6-f67bd2826930 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:16.627512 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c4ee99f9-4426-4d7c-93a6-f67bd2826930 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:16.634885 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c4ee99f9-4426-4d7c-93a6-f67bd2826930 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1506 microversion: 2.1 time: 0.152279 May 23 10:57:16.635443 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 330/675] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:16 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:17.261720 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-dc554091-2c59-4bdd-b6da-cf5dc86555aa req-269802a6-662f-4336-af3d-cffd3cc65af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8a09be-7c50-4fab-959e-164a1f0cfea3", "name": "network-vif-deleted", "tag": "6a9500e0-dd8b-4edc-8fb4-383677d888e0"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:17.271709 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-dc554091-2c59-4bdd-b6da-cf5dc86555aa req-269802a6-662f-4336-af3d-cffd3cc65af5 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:17.272231 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-dc554091-2c59-4bdd-b6da-cf5dc86555aa req-269802a6-662f-4336-af3d-cffd3cc65af5 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:17.283691 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-dc554091-2c59-4bdd-b6da-cf5dc86555aa req-269802a6-662f-4336-af3d-cffd3cc65af5 service nova] Creating event network-vif-deleted:6a9500e0-dd8b-4edc-8fb4-383677d888e0 for instance df8a09be-7c50-4fab-959e-164a1f0cfea3 on hv-cinder-83699 May 23 10:57:17.289282 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-dc554091-2c59-4bdd-b6da-cf5dc86555aa req-269802a6-662f-4336-af3d-cffd3cc65af5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095175 May 23 10:57:17.290218 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 346/676] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:17.653031 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:17.653809 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:17.661339 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:17.661809 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:17.662604 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:17.663036 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:17.695454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:17.695908 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:17.696359 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lazy-loading 'fault' on Instance uuid df8a09be-7c50-4fab-959e-164a1f0cfea3 {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:57:17.741569 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:17.748417 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0d412d70-8342-4c97-9ded-7e5e19cbfe1f tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 200 len: 1311 microversion: 2.1 time: 0.100002 May 23 10:57:17.748985 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 331/677] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:17 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:18.766185 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8753721a-e857-46c7-a5aa-8391a8577b85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:18.766904 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-8753721a-e857-46c7-a5aa-8391a8577b85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: df8a09be-7c50-4fab-959e-164a1f0cfea3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:18.773753 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8753721a-e857-46c7-a5aa-8391a8577b85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:18.773753 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8753721a-e857-46c7-a5aa-8391a8577b85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:18.774479 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8753721a-e857-46c7-a5aa-8391a8577b85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:18.774927 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8753721a-e857-46c7-a5aa-8391a8577b85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:18.788538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-8753721a-e857-46c7-a5aa-8391a8577b85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] HTTP exception thrown: Instance df8a09be-7c50-4fab-959e-164a1f0cfea3 could not be found. May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8753721a-e857-46c7-a5aa-8391a8577b85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Request method failure captured: May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 HTTP/1.1 May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2eLhnLJl1WQHI6AQhbejgYPFTmHkdxSbb8YGQPU-jfMtBrmgOgTu6SnJpnxYF42UIG9Y970L_Xtfbn7Z694Bj4Sxalc3YSV73HRTz_zeRlmCwMmhl_7B5-C6bxvl_9ZZJTQqwCn8HXEekRlTd41SnLC_JFnHqfCQzK0qmyt8KWdAzI May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 33781de828264846b90b5cbbbeee7fe5 May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:18.790166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33781de828264846b90b5cbbbeee7fe5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 33781de828264846b90b5cbbbeee7fe5 May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-ServerRescueNegativeTestJSON-485230613-project May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 06f644c1c44d4dafacbd5bbdde323ff0 May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-ServerRescueNegativeTestJSON-485230613-project May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance df8a09be-7c50-4fab-959e-164a1f0cfea3 could not be found. May 23 10:57:18.791552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'df8a09be-7c50-4fab-959e-164a1f0cfea3'} May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8a09be-7c50-4fab-959e-164a1f0cfea3 could not be found. May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:18.792366 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8a09be-7c50-4fab-959e-164a1f0cfea3 could not be found. May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8a09be-7c50-4fab-959e-164a1f0cfea3 could not be found. May 23 10:57:18.793824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:18.795253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8753721a-e857-46c7-a5aa-8391a8577b85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Returning 404 to user: Instance df8a09be-7c50-4fab-959e-164a1f0cfea3 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:18.795253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-8753721a-e857-46c7-a5aa-8391a8577b85 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3" status: 404 len: 111 microversion: 2.1 time: 0.030113 May 23 10:57:18.795253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 347/678] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:18 2022] GET /compute/v2.1/servers/df8a09be-7c50-4fab-959e-164a1f0cfea3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:18.800009 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a4b84898-991c-49f6-b480-d3a4141bb7d3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:18.800531 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a4b84898-991c-49f6-b480-d3a4141bb7d3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:18.807620 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4b84898-991c-49f6-b480-d3a4141bb7d3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:18.808067 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4b84898-991c-49f6-b480-d3a4141bb7d3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:18.808825 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4b84898-991c-49f6-b480-d3a4141bb7d3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:18.809253 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4b84898-991c-49f6-b480-d3a4141bb7d3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:18.833127 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a4b84898-991c-49f6-b480-d3a4141bb7d3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Going to try to terminate instance {{(pid=129030) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:57:18.907842 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a4b84898-991c-49f6-b480-d3a4141bb7d3 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 204 len: 0 microversion: 2.1 time: 0.111219 May 23 10:57:18.908646 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 332/679] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:18 2022] DELETE /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:57:18.917449 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-074e9ffa-b7d4-4636-8a26-4601e9a2b7e7 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:18.918186 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-074e9ffa-b7d4-4636-8a26-4601e9a2b7e7 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:18.924250 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-074e9ffa-b7d4-4636-8a26-4601e9a2b7e7 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:18.924692 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-074e9ffa-b7d4-4636-8a26-4601e9a2b7e7 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:18.925446 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-074e9ffa-b7d4-4636-8a26-4601e9a2b7e7 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:18.926518 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-074e9ffa-b7d4-4636-8a26-4601e9a2b7e7 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:19.054655 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-074e9ffa-b7d4-4636-8a26-4601e9a2b7e7 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:19.062066 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-074e9ffa-b7d4-4636-8a26-4601e9a2b7e7 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.148654 May 23 10:57:19.062615 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 348/680] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:18 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:57:20.080111 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-95c47b8e-18f8-49fd-ab9b-568076ee8679 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:20.080845 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-95c47b8e-18f8-49fd-ab9b-568076ee8679 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:20.087294 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-95c47b8e-18f8-49fd-ab9b-568076ee8679 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:20.087740 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-95c47b8e-18f8-49fd-ab9b-568076ee8679 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:20.088508 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-95c47b8e-18f8-49fd-ab9b-568076ee8679 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:20.088944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-95c47b8e-18f8-49fd-ab9b-568076ee8679 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:20.215658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-95c47b8e-18f8-49fd-ab9b-568076ee8679 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:20.223670 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-95c47b8e-18f8-49fd-ab9b-568076ee8679 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.147732 May 23 10:57:20.224242 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 333/681] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:20 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:21.239630 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e6034852-6e57-4da2-b71a-848d29462560 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:21.240179 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e6034852-6e57-4da2-b71a-848d29462560 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:21.246804 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e6034852-6e57-4da2-b71a-848d29462560 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:21.247254 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e6034852-6e57-4da2-b71a-848d29462560 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:21.248019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e6034852-6e57-4da2-b71a-848d29462560 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:21.248457 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e6034852-6e57-4da2-b71a-848d29462560 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:21.374717 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e6034852-6e57-4da2-b71a-848d29462560 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:21.382858 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e6034852-6e57-4da2-b71a-848d29462560 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.147161 May 23 10:57:21.383421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 349/682] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:21 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:22.400287 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ca9b26ba-6a71-487b-acb6-7583a0cbd5ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:22.400889 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ca9b26ba-6a71-487b-acb6-7583a0cbd5ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:22.407585 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ca9b26ba-6a71-487b-acb6-7583a0cbd5ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:22.408030 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ca9b26ba-6a71-487b-acb6-7583a0cbd5ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:22.408803 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ca9b26ba-6a71-487b-acb6-7583a0cbd5ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:22.409245 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ca9b26ba-6a71-487b-acb6-7583a0cbd5ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:22.536682 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ca9b26ba-6a71-487b-acb6-7583a0cbd5ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:22.544087 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ca9b26ba-6a71-487b-acb6-7583a0cbd5ec tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1522 microversion: 2.1 time: 0.147614 May 23 10:57:22.544666 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 334/683] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:22 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:23.397515 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-196ecb07-b61d-4e25-a8aa-5e5e4b88dcef req-9363fb52-dd88-4d80-9ff9-e86ce6cbc0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05d0a5e-e6bc-4234-b354-9792304bc88b", "name": "network-vif-deleted", "tag": "4ed45538-1b79-4cff-b740-d10665911054"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:23.406119 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-196ecb07-b61d-4e25-a8aa-5e5e4b88dcef req-9363fb52-dd88-4d80-9ff9-e86ce6cbc0a5 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:23.406558 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-196ecb07-b61d-4e25-a8aa-5e5e4b88dcef req-9363fb52-dd88-4d80-9ff9-e86ce6cbc0a5 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:23.418967 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-196ecb07-b61d-4e25-a8aa-5e5e4b88dcef req-9363fb52-dd88-4d80-9ff9-e86ce6cbc0a5 service nova] Creating event network-vif-deleted:4ed45538-1b79-4cff-b740-d10665911054 for instance d05d0a5e-e6bc-4234-b354-9792304bc88b on hv-cinder-83699 May 23 10:57:23.426617 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-196ecb07-b61d-4e25-a8aa-5e5e4b88dcef req-9363fb52-dd88-4d80-9ff9-e86ce6cbc0a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032316 May 23 10:57:23.427680 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 350/684] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:23.561091 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:23.562447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:23.570246 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:23.570952 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:23.571966 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:23.572447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:23.605034 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:23.605467 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:23.605919 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lazy-loading 'fault' on Instance uuid d05d0a5e-e6bc-4234-b354-9792304bc88b {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:57:23.645485 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f644c1c44d4dafacbd5bbdde323ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33781de828264846b90b5cbbbeee7fe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:23.653702 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b847d824-5acb-4931-8b95-02e1e2df0695 tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 200 len: 1312 microversion: 2.1 time: 0.096886 May 23 10:57:23.654311 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 335/685] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:23 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:24.056806 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9aef5645-8428-4da1-a315-f6c61a82ffd1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:24.057383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9aef5645-8428-4da1-a315-f6c61a82ffd1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:24.063878 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9aef5645-8428-4da1-a315-f6c61a82ffd1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.064381 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9aef5645-8428-4da1-a315-f6c61a82ffd1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.065306 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9aef5645-8428-4da1-a315-f6c61a82ffd1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.065716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9aef5645-8428-4da1-a315-f6c61a82ffd1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.149575 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-9aef5645-8428-4da1-a315-f6c61a82ffd1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lazy-loading 'services' on Instance uuid d6b7452a-2695-4e9e-9ad4-c72f9c820594 {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:57:24.221216 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9aef5645-8428-4da1-a315-f6c61a82ffd1 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments/cdd82ee8-3cbf-4f69-acbf-e7c875eb61a1" status: 202 len: 0 microversion: 2.1 time: 0.168572 May 23 10:57:24.221794 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 351/686] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 10:57:24 2022] DELETE /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments/cdd82ee8-3cbf-4f69-acbf-e7c875eb61a1 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:57:24.230425 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e3924b15-4d7b-471d-819b-8bb9ee6e930d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:24.232116 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e3924b15-4d7b-471d-819b-8bb9ee6e930d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:24.243836 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e3924b15-4d7b-471d-819b-8bb9ee6e930d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.244603 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e3924b15-4d7b-471d-819b-8bb9ee6e930d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.245058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e3924b15-4d7b-471d-819b-8bb9ee6e930d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.245489 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e3924b15-4d7b-471d-819b-8bb9ee6e930d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.280399 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e3924b15-4d7b-471d-819b-8bb9ee6e930d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054212 May 23 10:57:24.280957 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 336/687] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:24 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:24.603097 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-52c945ab-7bf8-41f6-b43e-6be466e20745 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:24.604106 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-52c945ab-7bf8-41f6-b43e-6be466e20745 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:24.610790 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-52c945ab-7bf8-41f6-b43e-6be466e20745 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.611245 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-52c945ab-7bf8-41f6-b43e-6be466e20745 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.612008 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-52c945ab-7bf8-41f6-b43e-6be466e20745 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.612451 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-52c945ab-7bf8-41f6-b43e-6be466e20745 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.640800 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-52c945ab-7bf8-41f6-b43e-6be466e20745 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042050 May 23 10:57:24.641336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 352/688] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:24 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 10:57:24.671013 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b9b9f2bc-8ed4-49f0-a61b-086e75986cdf tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:24.671628 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b9b9f2bc-8ed4-49f0-a61b-086e75986cdf tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] [instance: d05d0a5e-e6bc-4234-b354-9792304bc88b] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:24.678772 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b9b9f2bc-8ed4-49f0-a61b-086e75986cdf tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.679224 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b9b9f2bc-8ed4-49f0-a61b-086e75986cdf tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.679995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b9b9f2bc-8ed4-49f0-a61b-086e75986cdf tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.680433 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b9b9f2bc-8ed4-49f0-a61b-086e75986cdf tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.694176 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-b9b9f2bc-8ed4-49f0-a61b-086e75986cdf tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] HTTP exception thrown: Instance d05d0a5e-e6bc-4234-b354-9792304bc88b could not be found. May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b9b9f2bc-8ed4-49f0-a61b-086e75986cdf tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Request method failure captured: May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b HTTP/1.1 May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2eLhnLJl1WQHI6AQhbejgYPFTmHkdxSbb8YGQPU-jfMtBrmgOgTu6SnJpnxYF42UIG9Y970L_Xtfbn7Z694Bj4Sxalc3YSV73HRTz_zeRlmCwMmhl_7B5-C6bxvl_9ZZJTQqwCn8HXEekRlTd41SnLC_JFnHqfCQzK0qmyt8KWdAzI May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 33781de828264846b90b5cbbbeee7fe5 May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:24.695806 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33781de828264846b90b5cbbbeee7fe5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33781de828264846b90b5cbbbeee7fe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 33781de828264846b90b5cbbbeee7fe5 May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-485230613 May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-ServerRescueNegativeTestJSON-485230613-project May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 06f644c1c44d4dafacbd5bbdde323ff0 May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-ServerRescueNegativeTestJSON-485230613-project May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance d05d0a5e-e6bc-4234-b354-9792304bc88b could not be found. May 23 10:57:24.697304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'd05d0a5e-e6bc-4234-b354-9792304bc88b'} May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05d0a5e-e6bc-4234-b354-9792304bc88b could not be found. May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:24.698157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05d0a5e-e6bc-4234-b354-9792304bc88b could not be found. May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05d0a5e-e6bc-4234-b354-9792304bc88b could not be found. May 23 10:57:24.699570 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:24.701122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b9b9f2bc-8ed4-49f0-a61b-086e75986cdf tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] Returning 404 to user: Instance d05d0a5e-e6bc-4234-b354-9792304bc88b could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:24.701122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b9b9f2bc-8ed4-49f0-a61b-086e75986cdf tempest-ServerRescueNegativeTestJSON-485230613 tempest-ServerRescueNegativeTestJSON-485230613-project] 10.222.0.36 "GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b" status: 404 len: 111 microversion: 2.1 time: 0.029975 May 23 10:57:24.701122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 337/689] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:24 2022] GET /compute/v2.1/servers/d05d0a5e-e6bc-4234-b354-9792304bc88b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:24.747297 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5df3cb52-1dd7-4e20-87b0-f3bce7c33daf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:24.748528 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5df3cb52-1dd7-4e20-87b0-f3bce7c33daf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:24.754621 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5df3cb52-1dd7-4e20-87b0-f3bce7c33daf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.755069 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5df3cb52-1dd7-4e20-87b0-f3bce7c33daf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.755845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5df3cb52-1dd7-4e20-87b0-f3bce7c33daf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.756285 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5df3cb52-1dd7-4e20-87b0-f3bce7c33daf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.785663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5df3cb52-1dd7-4e20-87b0-f3bce7c33daf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041640 May 23 10:57:24.786442 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 353/690] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:24 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 10:57:24.848382 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-784254f6-841a-4602-b280-348c9452e1ad tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:24.848926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-784254f6-841a-4602-b280-348c9452e1ad tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:24.855268 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-784254f6-841a-4602-b280-348c9452e1ad tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.855711 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-784254f6-841a-4602-b280-348c9452e1ad tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.856470 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-784254f6-841a-4602-b280-348c9452e1ad tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.857073 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-784254f6-841a-4602-b280-348c9452e1ad tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.883753 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-784254f6-841a-4602-b280-348c9452e1ad tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Going to try to terminate instance {{(pid=129030) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:57:24.959177 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-784254f6-841a-4602-b280-348c9452e1ad tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 204 len: 0 microversion: 2.1 time: 0.115565 May 23 10:57:24.959804 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 338/691] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:24 2022] DELETE /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:57:24.968501 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-132d677e-ed22-4bb1-a090-f8d2502a0706 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:24.969248 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-132d677e-ed22-4bb1-a090-f8d2502a0706 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:24.975934 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-132d677e-ed22-4bb1-a090-f8d2502a0706 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.976462 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-132d677e-ed22-4bb1-a090-f8d2502a0706 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:24.977309 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-132d677e-ed22-4bb1-a090-f8d2502a0706 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:24.977823 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-132d677e-ed22-4bb1-a090-f8d2502a0706 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:25.231208 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-132d677e-ed22-4bb1-a090-f8d2502a0706 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:25.239060 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-132d677e-ed22-4bb1-a090-f8d2502a0706 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1675 microversion: 2.1 time: 0.274456 May 23 10:57:25.239888 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 354/692] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:24 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1675 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:25.292765 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-011e0487-2345-4ac0-9b43-d59973edf50f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:25.293809 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-011e0487-2345-4ac0-9b43-d59973edf50f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:25.299803 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-011e0487-2345-4ac0-9b43-d59973edf50f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:25.300255 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-011e0487-2345-4ac0-9b43-d59973edf50f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:25.301023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-011e0487-2345-4ac0-9b43-d59973edf50f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:25.301455 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-011e0487-2345-4ac0-9b43-d59973edf50f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:25.330567 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-011e0487-2345-4ac0-9b43-d59973edf50f tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042094 May 23 10:57:25.331130 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 339/693] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:25 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:26.256629 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d6b5245f-3a0f-4aab-93dc-543b5ef78e4f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:26.257331 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d6b5245f-3a0f-4aab-93dc-543b5ef78e4f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:26.264247 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6b5245f-3a0f-4aab-93dc-543b5ef78e4f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:26.264698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6b5245f-3a0f-4aab-93dc-543b5ef78e4f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:26.265464 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6b5245f-3a0f-4aab-93dc-543b5ef78e4f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:26.265903 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d6b5245f-3a0f-4aab-93dc-543b5ef78e4f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:26.285533 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:26.342576 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f6390063-ed41-43a8-9461-7f93984dac84 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:26.343538 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f6390063-ed41-43a8-9461-7f93984dac84 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:26.350874 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f6390063-ed41-43a8-9461-7f93984dac84 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:26.351318 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f6390063-ed41-43a8-9461-7f93984dac84 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:26.352082 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f6390063-ed41-43a8-9461-7f93984dac84 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:26.352512 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f6390063-ed41-43a8-9461-7f93984dac84 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:26.382732 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f6390063-ed41-43a8-9461-7f93984dac84 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 May 23 10:57:26.383303 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 340/694] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:26 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:57:26.487512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d6b5245f-3a0f-4aab-93dc-543b5ef78e4f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:26.495621 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d6b5245f-3a0f-4aab-93dc-543b5ef78e4f tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1675 microversion: 2.1 time: 0.242762 May 23 10:57:26.496483 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 355/695] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:26 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:27.394213 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-408eb36b-9f17-4c93-966a-78eec0f16409 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:27.395187 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-408eb36b-9f17-4c93-966a-78eec0f16409 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:27.402032 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-408eb36b-9f17-4c93-966a-78eec0f16409 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:27.402487 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-408eb36b-9f17-4c93-966a-78eec0f16409 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:27.403436 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-408eb36b-9f17-4c93-966a-78eec0f16409 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:27.404038 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-408eb36b-9f17-4c93-966a-78eec0f16409 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:27.408093 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:27.439613 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-408eb36b-9f17-4c93-966a-78eec0f16409 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049201 May 23 10:57:27.440447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 341/696] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 10:57:27 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 10:57:27.513069 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-43fd1d47-1899-45e6-a012-a377ae19f104 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:27.513695 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-43fd1d47-1899-45e6-a012-a377ae19f104 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:27.518845 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e8f9deb4-f014-414a-a275-d0c6449e2b4d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:27.519384 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e8f9deb4-f014-414a-a275-d0c6449e2b4d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:27.529142 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8f9deb4-f014-414a-a275-d0c6449e2b4d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:27.529247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8f9deb4-f014-414a-a275-d0c6449e2b4d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:27.530074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8f9deb4-f014-414a-a275-d0c6449e2b4d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:27.530521 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e8f9deb4-f014-414a-a275-d0c6449e2b4d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:27.538304 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-43fd1d47-1899-45e6-a012-a377ae19f104 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:27.538762 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-43fd1d47-1899-45e6-a012-a377ae19f104 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:27.539551 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-43fd1d47-1899-45e6-a012-a377ae19f104 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:27.539990 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-43fd1d47-1899-45e6-a012-a377ae19f104 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:27.581209 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e8f9deb4-f014-414a-a275-d0c6449e2b4d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Going to try to terminate instance {{(pid=129030) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:57:27.694623 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e8f9deb4-f014-414a-a275-d0c6449e2b4d tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 204 len: 0 microversion: 2.1 time: 0.178967 May 23 10:57:27.695657 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 342/697] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:27 2022] DELETE /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:57:27.706961 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5a1e832a-ea64-4fde-9da9-bb6010df79e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:27.707837 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5a1e832a-ea64-4fde-9da9-bb6010df79e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:27.715017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5a1e832a-ea64-4fde-9da9-bb6010df79e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:27.715482 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5a1e832a-ea64-4fde-9da9-bb6010df79e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:27.716273 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5a1e832a-ea64-4fde-9da9-bb6010df79e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:27.716715 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5a1e832a-ea64-4fde-9da9-bb6010df79e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:27.786509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-43fd1d47-1899-45e6-a012-a377ae19f104 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:27.796822 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-43fd1d47-1899-45e6-a012-a377ae19f104 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1675 microversion: 2.1 time: 0.288240 May 23 10:57:27.797415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 356/698] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:27 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1675 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:28.357464 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5a1e832a-ea64-4fde-9da9-bb6010df79e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:28.365721 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5a1e832a-ea64-4fde-9da9-bb6010df79e0 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1681 microversion: 2.1 time: 0.665972 May 23 10:57:28.366336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 343/699] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:27 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1681 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:28.628982 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-bf378a75-6c41-4c0c-8982-d6a2c77cb438 req-1c01a8df-6a9a-412e-9863-b9397448b278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c331e053-3f7e-42c9-9f4e-4601f4aa98f9", "name": "network-vif-deleted", "tag": "63718413-eeaa-494a-a96d-9c895af0fe1d"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:28.637936 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-bf378a75-6c41-4c0c-8982-d6a2c77cb438 req-1c01a8df-6a9a-412e-9863-b9397448b278 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:28.638396 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-bf378a75-6c41-4c0c-8982-d6a2c77cb438 req-1c01a8df-6a9a-412e-9863-b9397448b278 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:28.649389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-bf378a75-6c41-4c0c-8982-d6a2c77cb438 req-1c01a8df-6a9a-412e-9863-b9397448b278 service nova] Creating event network-vif-deleted:63718413-eeaa-494a-a96d-9c895af0fe1d for instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 on hv-cinder-83699 May 23 10:57:28.654391 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-bf378a75-6c41-4c0c-8982-d6a2c77cb438 req-1c01a8df-6a9a-412e-9863-b9397448b278 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029002 May 23 10:57:28.655254 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 357/700] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:28.823468 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-21bb8d5c-d8ed-4a91-9237-bf1387934298 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:28.824172 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-21bb8d5c-d8ed-4a91-9237-bf1387934298 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:28.840290 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-21bb8d5c-d8ed-4a91-9237-bf1387934298 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:28.840759 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-21bb8d5c-d8ed-4a91-9237-bf1387934298 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:28.841543 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-21bb8d5c-d8ed-4a91-9237-bf1387934298 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:28.841991 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-21bb8d5c-d8ed-4a91-9237-bf1387934298 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:28.915215 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-21bb8d5c-d8ed-4a91-9237-bf1387934298 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:28.924384 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-21bb8d5c-d8ed-4a91-9237-bf1387934298 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1607 microversion: 2.1 time: 0.112993 May 23 10:57:28.925320 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 344/701] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:28 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1607 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:29.384517 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-aa344f6b-3c0e-45d8-8e9c-ff52f7a1a87b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:29.385525 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-aa344f6b-3c0e-45d8-8e9c-ff52f7a1a87b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:29.392461 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa344f6b-3c0e-45d8-8e9c-ff52f7a1a87b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:29.393569 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa344f6b-3c0e-45d8-8e9c-ff52f7a1a87b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:29.395166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa344f6b-3c0e-45d8-8e9c-ff52f7a1a87b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:29.396196 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa344f6b-3c0e-45d8-8e9c-ff52f7a1a87b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:29.543123 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-aa344f6b-3c0e-45d8-8e9c-ff52f7a1a87b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:29.553224 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-aa344f6b-3c0e-45d8-8e9c-ff52f7a1a87b tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1681 microversion: 2.1 time: 0.173021 May 23 10:57:29.562902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 358/702] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:29 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:29.945110 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:29.946308 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:29.954871 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:29.955342 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:29.956333 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:29.956970 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:30.000063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:30.000966 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:30.001577 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lazy-loading 'fault' on Instance uuid c331e053-3f7e-42c9-9f4e-4601f4aa98f9 {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:57:30.055835 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1fc33c4ee0c4b30a862f6685817bdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d45f08040d949bd8949e3d1faab25c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:30.063101 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-667f73bb-4a09-4eba-aaa3-059bbd50d10c tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 200 len: 1327 microversion: 2.1 time: 0.124482 May 23 10:57:30.064025 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 345/703] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:29 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:30.569466 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5c5800da-56e4-4041-8551-3e9b11881f48 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:30.572807 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5c5800da-56e4-4041-8551-3e9b11881f48 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:30.579527 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5c5800da-56e4-4041-8551-3e9b11881f48 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:30.580181 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5c5800da-56e4-4041-8551-3e9b11881f48 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:30.581229 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5c5800da-56e4-4041-8551-3e9b11881f48 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:30.582192 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5c5800da-56e4-4041-8551-3e9b11881f48 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:30.647607 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5c5800da-56e4-4041-8551-3e9b11881f48 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98c8ceac6b47079423b45685c5ba3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4a5543a3f41a6b3dab9250c0ce9be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:30.655343 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5c5800da-56e4-4041-8551-3e9b11881f48 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 200 len: 1613 microversion: 2.1 time: 0.089750 May 23 10:57:30.656192 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 359/704] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:30 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:30.737282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-799997a8-0324-41d3-99da-e0d19f448030 req-30c0f872-1da5-47cb-9183-64bf96053204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b7452a-2695-4e9e-9ad4-c72f9c820594", "name": "network-vif-deleted", "tag": "6df75980-9946-423c-9150-f2fe9406a3f6"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:30.748634 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-799997a8-0324-41d3-99da-e0d19f448030 req-30c0f872-1da5-47cb-9183-64bf96053204 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:30.749084 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-799997a8-0324-41d3-99da-e0d19f448030 req-30c0f872-1da5-47cb-9183-64bf96053204 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:30.761819 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-799997a8-0324-41d3-99da-e0d19f448030 req-30c0f872-1da5-47cb-9183-64bf96053204 service nova] Creating event network-vif-deleted:6df75980-9946-423c-9150-f2fe9406a3f6 for instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 on hv-cinder-83699 May 23 10:57:30.768009 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-799997a8-0324-41d3-99da-e0d19f448030 req-30c0f872-1da5-47cb-9183-64bf96053204 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034153 May 23 10:57:30.774346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 346/705] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:31.081732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b7b3929d-4e66-4dd7-98f5-9f17527d6a41 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:31.082463 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b7b3929d-4e66-4dd7-98f5-9f17527d6a41 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:31.088476 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7b3929d-4e66-4dd7-98f5-9f17527d6a41 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:31.089002 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7b3929d-4e66-4dd7-98f5-9f17527d6a41 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:31.089838 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7b3929d-4e66-4dd7-98f5-9f17527d6a41 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:31.090373 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b7b3929d-4e66-4dd7-98f5-9f17527d6a41 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:31.103472 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-b7b3929d-4e66-4dd7-98f5-9f17527d6a41 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] HTTP exception thrown: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b7b3929d-4e66-4dd7-98f5-9f17527d6a41 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Request method failure captured: May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 HTTP/1.1 May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dCFcFqXq8b907zUpLlmRr5-RUrAOAWaYlzJWyyEWlYabqPEH2Lpu7WoZoU35ImXoeg3o69t6eta2Iqxnzx-5Tz8K3zmNwKu287wnOrByYhvJu_dcvtIprkSRE_03bp_VwD5BFdr6n4SZI3GeNKKyREDTpe1V8QUiBui4bJ9_YhrPk May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:31.105264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d45f08040d949bd8949e3d1faab25c4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeTestJSON-624332084-project May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: a1fc33c4ee0c4b30a862f6685817bdf4 May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeTestJSON-624332084-project May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:31.106676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'c331e053-3f7e-42c9-9f4e-4601f4aa98f9'} May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:31.107403 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:31.108619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:31.110156 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b7b3929d-4e66-4dd7-98f5-9f17527d6a41 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Returning 404 to user: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:31.110156 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b7b3929d-4e66-4dd7-98f5-9f17527d6a41 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 404 len: 111 microversion: 2.1 time: 0.029651 May 23 10:57:31.111800 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 360/706] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:31 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:31.118055 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d48ac085-2cb9-47df-a1ee-5bf4c9c53cec tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '.version_select at 0x7fe71b7f0ca0>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:31.136100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d48ac085-2cb9-47df-a1ee-5bf4c9c53cec tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031793595" status: 202 len: 0 microversion: 2.1 time: 0.022912 May 23 10:57:31.136783 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 347/707] 10.222.0.36 () {58 vars in 1220 bytes} [Mon May 23 10:57:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031793595 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 10:57:31.673377 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a392eb13-8198-4d6c-ba0b-9347531c21ca tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:31.674581 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a392eb13-8198-4d6c-ba0b-9347531c21ca tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:31.681614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a392eb13-8198-4d6c-ba0b-9347531c21ca tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:31.682325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a392eb13-8198-4d6c-ba0b-9347531c21ca tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:31.683274 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a392eb13-8198-4d6c-ba0b-9347531c21ca tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:31.683716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a392eb13-8198-4d6c-ba0b-9347531c21ca tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:31.698521 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-a392eb13-8198-4d6c-ba0b-9347531c21ca tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a392eb13-8198-4d6c-ba0b-9347531c21ca tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 HTTP/1.1 May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:31.700315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:31.701712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'd6b7452a-2695-4e9e-9ad4-c72f9c820594'} May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:31.702474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:31.703616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:31.706822 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a392eb13-8198-4d6c-ba0b-9347531c21ca tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:31.707969 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a392eb13-8198-4d6c-ba0b-9347531c21ca tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 404 len: 111 microversion: 2.1 time: 0.039068 May 23 10:57:31.709053 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 361/708] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:31 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:31.717971 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-547b1982-0136-4eec-8ec0-645944d667fa tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '.version_select at 0x7fe71b79f040>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:31.740966 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-547b1982-0136-4eec-8ec0-645944d667fa tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965719522" status: 202 len: 0 microversion: 2.1 time: 0.027432 May 23 10:57:31.741562 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 348/709] 10.222.0.36 () {58 vars in 1220 bytes} [Mon May 23 10:57:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965719522 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 10:57:33.534852 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1433fc39-3e54-4c1b-8bfd-b152b7054c67 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:33.535380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1433fc39-3e54-4c1b-8bfd-b152b7054c67 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:33.541738 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1433fc39-3e54-4c1b-8bfd-b152b7054c67 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:33.542223 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1433fc39-3e54-4c1b-8bfd-b152b7054c67 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:33.542992 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1433fc39-3e54-4c1b-8bfd-b152b7054c67 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:33.543432 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1433fc39-3e54-4c1b-8bfd-b152b7054c67 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:33.557144 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-1433fc39-3e54-4c1b-8bfd-b152b7054c67 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1433fc39-3e54-4c1b-8bfd-b152b7054c67 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 HTTP/1.1 May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:33.558698 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:33.560198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'd6b7452a-2695-4e9e-9ad4-c72f9c820594'} May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:33.561041 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:33.562486 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:33.563874 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1433fc39-3e54-4c1b-8bfd-b152b7054c67 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:33.563874 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1433fc39-3e54-4c1b-8bfd-b152b7054c67 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 404 len: 111 microversion: 2.1 time: 0.029075 May 23 10:57:33.563874 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 362/710] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:33 2022] DELETE /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:33.569137 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7324dec2-e984-429a-bd9c-fac22390b151 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:33.569866 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-7324dec2-e984-429a-bd9c-fac22390b151 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: d6b7452a-2695-4e9e-9ad4-c72f9c820594] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:33.576652 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7324dec2-e984-429a-bd9c-fac22390b151 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:33.577046 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7324dec2-e984-429a-bd9c-fac22390b151 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:33.577803 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7324dec2-e984-429a-bd9c-fac22390b151 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:33.578260 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7324dec2-e984-429a-bd9c-fac22390b151 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:33.591521 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-7324dec2-e984-429a-bd9c-fac22390b151 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7324dec2-e984-429a-bd9c-fac22390b151 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 HTTP/1.1 May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:33.593159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:33.594741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'd6b7452a-2695-4e9e-9ad4-c72f9c820594'} May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:33.599169 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. May 23 10:57:33.600588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:33.602143 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7324dec2-e984-429a-bd9c-fac22390b151 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance d6b7452a-2695-4e9e-9ad4-c72f9c820594 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:33.602143 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-7324dec2-e984-429a-bd9c-fac22390b151 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594" status: 404 len: 111 microversion: 2.1 time: 0.029891 May 23 10:57:33.602143 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 349/711] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:33 2022] GET /compute/v2.1/servers/d6b7452a-2695-4e9e-9ad4-c72f9c820594 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:34.047949 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b2708ac6-1821-4477-b575-ad1d91038282 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:34.048448 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b2708ac6-1821-4477-b575-ad1d91038282 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:34.055256 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b2708ac6-1821-4477-b575-ad1d91038282 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.055708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b2708ac6-1821-4477-b575-ad1d91038282 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.056474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b2708ac6-1821-4477-b575-ad1d91038282 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.056928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b2708ac6-1821-4477-b575-ad1d91038282 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.071139 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-b2708ac6-1821-4477-b575-ad1d91038282 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] HTTP exception thrown: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b2708ac6-1821-4477-b575-ad1d91038282 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Request method failure captured: May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 HTTP/1.1 May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dCFcFqXq8b907zUpLlmRr5-RUrAOAWaYlzJWyyEWlYabqPEH2Lpu7WoZoU35ImXoeg3o69t6eta2Iqxnzx-5Tz8K3zmNwKu287wnOrByYhvJu_dcvtIprkSRE_03bp_VwD5BFdr6n4SZI3GeNKKyREDTpe1V8QUiBui4bJ9_YhrPk May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:34.072912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d45f08040d949bd8949e3d1faab25c4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeTestJSON-624332084-project May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: a1fc33c4ee0c4b30a862f6685817bdf4 May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeTestJSON-624332084-project May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:34.074526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'c331e053-3f7e-42c9-9f4e-4601f4aa98f9'} May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:34.075456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:34.076687 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.077824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b2708ac6-1821-4477-b575-ad1d91038282 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Returning 404 to user: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:34.077824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b2708ac6-1821-4477-b575-ad1d91038282 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 404 len: 111 microversion: 2.1 time: 0.030345 May 23 10:57:34.077824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 363/712] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:34 2022] DELETE /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:34.084636 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3b5484fb-35aa-45ba-9339-ca3986a9abcf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:34.085266 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3b5484fb-35aa-45ba-9339-ca3986a9abcf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: c331e053-3f7e-42c9-9f4e-4601f4aa98f9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:34.091558 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b5484fb-35aa-45ba-9339-ca3986a9abcf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.092083 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b5484fb-35aa-45ba-9339-ca3986a9abcf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.092934 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b5484fb-35aa-45ba-9339-ca3986a9abcf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.093586 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3b5484fb-35aa-45ba-9339-ca3986a9abcf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.107877 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-3b5484fb-35aa-45ba-9339-ca3986a9abcf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] HTTP exception thrown: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3b5484fb-35aa-45ba-9339-ca3986a9abcf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Request method failure captured: May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 HTTP/1.1 May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dCFcFqXq8b907zUpLlmRr5-RUrAOAWaYlzJWyyEWlYabqPEH2Lpu7WoZoU35ImXoeg3o69t6eta2Iqxnzx-5Tz8K3zmNwKu287wnOrByYhvJu_dcvtIprkSRE_03bp_VwD5BFdr6n4SZI3GeNKKyREDTpe1V8QUiBui4bJ9_YhrPk May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:34.109398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d45f08040d949bd8949e3d1faab25c4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeTestJSON-624332084-project May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: a1fc33c4ee0c4b30a862f6685817bdf4 May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeTestJSON-624332084-project May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:34.111061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'c331e053-3f7e-42c9-9f4e-4601f4aa98f9'} May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:34.111771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. May 23 10:57:34.112926 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.113924 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3b5484fb-35aa-45ba-9339-ca3986a9abcf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Returning 404 to user: Instance c331e053-3f7e-42c9-9f4e-4601f4aa98f9 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:34.113924 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3b5484fb-35aa-45ba-9339-ca3986a9abcf tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9" status: 404 len: 111 microversion: 2.1 time: 0.030620 May 23 10:57:34.113924 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 350/713] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:34 2022] GET /compute/v2.1/servers/c331e053-3f7e-42c9-9f4e-4601f4aa98f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:34.736452 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9c6ffbdc-a76c-4fc3-b1da-87e71736476c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:34.736995 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9c6ffbdc-a76c-4fc3-b1da-87e71736476c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:34.743869 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9c6ffbdc-a76c-4fc3-b1da-87e71736476c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.744314 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9c6ffbdc-a76c-4fc3-b1da-87e71736476c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.745081 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9c6ffbdc-a76c-4fc3-b1da-87e71736476c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.745507 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9c6ffbdc-a76c-4fc3-b1da-87e71736476c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.760187 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-9c6ffbdc-a76c-4fc3-b1da-87e71736476c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9c6ffbdc-a76c-4fc3-b1da-87e71736476c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 HTTP/1.1 May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:34.761726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:57:34.763273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'e34bc626-48f7-41fe-9f92-2581c01532d9'} May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:34.764062 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:57:34.765402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.766678 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9c6ffbdc-a76c-4fc3-b1da-87e71736476c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:34.766678 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9c6ffbdc-a76c-4fc3-b1da-87e71736476c tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 404 len: 111 microversion: 2.1 time: 0.030509 May 23 10:57:34.766678 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 364/714] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:34 2022] DELETE /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:34.771827 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bdc471b4-aff2-4dfa-ae66-5cfe4219be9a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:34.772622 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-bdc471b4-aff2-4dfa-ae66-5cfe4219be9a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: e34bc626-48f7-41fe-9f92-2581c01532d9] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:34.778985 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bdc471b4-aff2-4dfa-ae66-5cfe4219be9a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.779429 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bdc471b4-aff2-4dfa-ae66-5cfe4219be9a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.780194 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bdc471b4-aff2-4dfa-ae66-5cfe4219be9a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.780622 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bdc471b4-aff2-4dfa-ae66-5cfe4219be9a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.794346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-bdc471b4-aff2-4dfa-ae66-5cfe4219be9a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bdc471b4-aff2-4dfa-ae66-5cfe4219be9a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 HTTP/1.1 May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:34.795859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:57:34.797307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'e34bc626-48f7-41fe-9f92-2581c01532d9'} May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:34.798288 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. May 23 10:57:34.799716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.800994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bdc471b4-aff2-4dfa-ae66-5cfe4219be9a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance e34bc626-48f7-41fe-9f92-2581c01532d9 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:34.800994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-bdc471b4-aff2-4dfa-ae66-5cfe4219be9a tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9" status: 404 len: 111 microversion: 2.1 time: 0.029490 May 23 10:57:34.800994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 351/715] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:34 2022] GET /compute/v2.1/servers/e34bc626-48f7-41fe-9f92-2581c01532d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:34.807157 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3afce1ec-1bda-462b-8db4-be7f2f68d080 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:34.807646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3afce1ec-1bda-462b-8db4-be7f2f68d080 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:34.813574 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3afce1ec-1bda-462b-8db4-be7f2f68d080 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.814058 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3afce1ec-1bda-462b-8db4-be7f2f68d080 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.814815 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3afce1ec-1bda-462b-8db4-be7f2f68d080 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.815247 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3afce1ec-1bda-462b-8db4-be7f2f68d080 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.828526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-3afce1ec-1bda-462b-8db4-be7f2f68d080 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3afce1ec-1bda-462b-8db4-be7f2f68d080 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 HTTP/1.1 May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:34.830068 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:57:34.831571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'fc1671c4-e70e-4431-88d7-9ea12615aa07'} May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:34.835365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:57:34.836732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:34.838146 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3afce1ec-1bda-462b-8db4-be7f2f68d080 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:34.838146 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3afce1ec-1bda-462b-8db4-be7f2f68d080 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 404 len: 111 microversion: 2.1 time: 0.028075 May 23 10:57:34.838146 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 365/716] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:34 2022] DELETE /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:34.843430 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1e9094b6-a13a-499a-869a-cb154bb3d694 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:34.843952 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1e9094b6-a13a-499a-869a-cb154bb3d694 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: fc1671c4-e70e-4431-88d7-9ea12615aa07] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:34.850532 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1e9094b6-a13a-499a-869a-cb154bb3d694 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.851044 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1e9094b6-a13a-499a-869a-cb154bb3d694 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.851810 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1e9094b6-a13a-499a-869a-cb154bb3d694 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:34.852246 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1e9094b6-a13a-499a-869a-cb154bb3d694 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:34.866674 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-1e9094b6-a13a-499a-869a-cb154bb3d694 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1e9094b6-a13a-499a-869a-cb154bb3d694 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 HTTP/1.1 May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:34.868197 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:57:34.869689 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'fc1671c4-e70e-4431-88d7-9ea12615aa07'} May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:34.870787 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. May 23 10:57:34.872198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:34.874235 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1e9094b6-a13a-499a-869a-cb154bb3d694 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance fc1671c4-e70e-4431-88d7-9ea12615aa07 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:34.875082 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1e9094b6-a13a-499a-869a-cb154bb3d694 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07" status: 404 len: 111 microversion: 2.1 time: 0.035561 May 23 10:57:34.875944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 352/717] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:34 2022] GET /compute/v2.1/servers/fc1671c4-e70e-4431-88d7-9ea12615aa07 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:35.254693 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0b508e3b-1844-4e8d-809f-88fb4d6e3e96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:35.255368 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-0b508e3b-1844-4e8d-809f-88fb4d6e3e96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:35.261414 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0b508e3b-1844-4e8d-809f-88fb4d6e3e96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:35.261871 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0b508e3b-1844-4e8d-809f-88fb4d6e3e96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:35.262678 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0b508e3b-1844-4e8d-809f-88fb4d6e3e96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:35.263120 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0b508e3b-1844-4e8d-809f-88fb4d6e3e96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:35.278725 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-0b508e3b-1844-4e8d-809f-88fb4d6e3e96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] HTTP exception thrown: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0b508e3b-1844-4e8d-809f-88fb4d6e3e96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Request method failure captured: May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 HTTP/1.1 May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dCFcFqXq8b907zUpLlmRr5-RUrAOAWaYlzJWyyEWlYabqPEH2Lpu7WoZoU35ImXoeg3o69t6eta2Iqxnzx-5Tz8K3zmNwKu287wnOrByYhvJu_dcvtIprkSRE_03bp_VwD5BFdr6n4SZI3GeNKKyREDTpe1V8QUiBui4bJ9_YhrPk May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:35.280277 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d45f08040d949bd8949e3d1faab25c4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeTestJSON-624332084-project May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: a1fc33c4ee0c4b30a862f6685817bdf4 May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeTestJSON-624332084-project May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:57:35.281845 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '6e4944e0-e16e-4fc7-af6e-bfc128b079a8'} May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:35.282673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:57:35.283855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:35.285010 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0b508e3b-1844-4e8d-809f-88fb4d6e3e96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Returning 404 to user: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:35.285010 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-0b508e3b-1844-4e8d-809f-88fb4d6e3e96 tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 404 len: 111 microversion: 2.1 time: 0.032336 May 23 10:57:35.285010 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 366/718] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:35 2022] DELETE /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 10:57:35.291072 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-48cc9f2e-5bad-4736-9155-c8d623aff19a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:35.291679 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-48cc9f2e-5bad-4736-9155-c8d623aff19a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] [instance: 6e4944e0-e16e-4fc7-af6e-bfc128b079a8] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:35.297756 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-48cc9f2e-5bad-4736-9155-c8d623aff19a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:35.298232 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-48cc9f2e-5bad-4736-9155-c8d623aff19a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:35.299004 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-48cc9f2e-5bad-4736-9155-c8d623aff19a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:35.299439 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-48cc9f2e-5bad-4736-9155-c8d623aff19a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:35.312975 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-48cc9f2e-5bad-4736-9155-c8d623aff19a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] HTTP exception thrown: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-48cc9f2e-5bad-4736-9155-c8d623aff19a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Request method failure captured: May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 HTTP/1.1 May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dCFcFqXq8b907zUpLlmRr5-RUrAOAWaYlzJWyyEWlYabqPEH2Lpu7WoZoU35ImXoeg3o69t6eta2Iqxnzx-5Tz8K3zmNwKu287wnOrByYhvJu_dcvtIprkSRE_03bp_VwD5BFdr6n4SZI3GeNKKyREDTpe1V8QUiBui4bJ9_YhrPk May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:35.314514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d45f08040d949bd8949e3d1faab25c4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d45f08040d949bd8949e3d1faab25c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 3d45f08040d949bd8949e3d1faab25c4 May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeTestJSON-624332084 May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeTestJSON-624332084-project May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: a1fc33c4ee0c4b30a862f6685817bdf4 May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeTestJSON-624332084-project May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:57:35.316125 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': '6e4944e0-e16e-4fc7-af6e-bfc128b079a8'} May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:35.317220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. May 23 10:57:35.318548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:35.319629 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-48cc9f2e-5bad-4736-9155-c8d623aff19a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] Returning 404 to user: Instance 6e4944e0-e16e-4fc7-af6e-bfc128b079a8 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:35.319629 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-48cc9f2e-5bad-4736-9155-c8d623aff19a tempest-AttachVolumeTestJSON-624332084 tempest-AttachVolumeTestJSON-624332084-project] 10.222.0.36 "GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8" status: 404 len: 111 microversion: 2.1 time: 0.029197 May 23 10:57:35.319629 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 353/719] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:35 2022] GET /compute/v2.1/servers/6e4944e0-e16e-4fc7-af6e-bfc128b079a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:36.015812 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cab97c7d-8862-4e3a-a27a-d590d22fcaae tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:36.016364 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-cab97c7d-8862-4e3a-a27a-d590d22fcaae tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:36.023272 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cab97c7d-8862-4e3a-a27a-d590d22fcaae tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:36.023728 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cab97c7d-8862-4e3a-a27a-d590d22fcaae tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:36.024504 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cab97c7d-8862-4e3a-a27a-d590d22fcaae tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:36.025119 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cab97c7d-8862-4e3a-a27a-d590d22fcaae tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:36.041868 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-cab97c7d-8862-4e3a-a27a-d590d22fcaae tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cab97c7d-8862-4e3a-a27a-d590d22fcaae tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d HTTP/1.1 May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:36.043443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:57:36.044910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'f3019f51-1a3a-4457-a89a-9ba5759f792d'} May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:36.045764 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:57:36.047235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:36.049386 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cab97c7d-8862-4e3a-a27a-d590d22fcaae tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:36.050621 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-cab97c7d-8862-4e3a-a27a-d590d22fcaae tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 404 len: 111 microversion: 2.1 time: 0.038623 May 23 10:57:36.051321 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 367/720] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:36 2022] DELETE /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:36.059980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6dcd13cb-f844-4127-8f2c-f70573b00631 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:36.060692 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6dcd13cb-f844-4127-8f2c-f70573b00631 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] [instance: f3019f51-1a3a-4457-a89a-9ba5759f792d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:36.067211 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6dcd13cb-f844-4127-8f2c-f70573b00631 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:36.068224 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6dcd13cb-f844-4127-8f2c-f70573b00631 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:36.068997 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6dcd13cb-f844-4127-8f2c-f70573b00631 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:36.069431 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6dcd13cb-f844-4127-8f2c-f70573b00631 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:36.084203 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-6dcd13cb-f844-4127-8f2c-f70573b00631 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] HTTP exception thrown: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6dcd13cb-f844-4127-8f2c-f70573b00631 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Request method failure captured: May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d HTTP/1.1 May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dGpklnaIAXltIUy0QCObjSmmbES3WuMEETBoz36_MxSjCIud70Y7lCKP6ib_FgmXgZP1N4y9Edvpj1646zqOQCPojytnp2FXJErLjMlSO-Mkh7Bv4EJofLFtL3s-cvzNwswn04AAOr3inbh6PxAR_oJtKn79w0cFSxMjp5fNnnVho May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:36.086063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_00d4a5543a3f41a6b3dab9250c0ce9be", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/00d4a5543a3f41a6b3dab9250c0ce9be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 00d4a5543a3f41a6b3dab9250c0ce9be May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1799435181 May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 8e98c8ceac6b47079423b45685c5ba3e May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeNegativeTest-1799435181-project May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:57:36.087651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'f3019f51-1a3a-4457-a89a-9ba5759f792d'} May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:36.088571 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. May 23 10:57:36.090016 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:36.091308 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6dcd13cb-f844-4127-8f2c-f70573b00631 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] Returning 404 to user: Instance f3019f51-1a3a-4457-a89a-9ba5759f792d could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:36.091308 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6dcd13cb-f844-4127-8f2c-f70573b00631 tempest-AttachVolumeNegativeTest-1799435181 tempest-AttachVolumeNegativeTest-1799435181-project] 10.222.0.36 "GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d" status: 404 len: 111 microversion: 2.1 time: 0.031478 May 23 10:57:36.091308 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 354/721] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:36 2022] GET /compute/v2.1/servers/f3019f51-1a3a-4457-a89a-9ba5759f792d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 10:57:41.709889 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-856fa70c-cd62-4481-a308-8656862c359f tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Action: 'create', calling method: .version_select at 0x7fe7200f0160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-734770359", "metadata": {"Type": "work"}}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-856fa70c-cd62-4481-a308-8656862c359f tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Request method failure captured: May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 121 May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2il-BXDk1qnpwPNVCsrIfBaycHNZ45hle44dduyOUMDyBk7tnxqddEcwO9AZ1HW0lTHvBVDVIPJMUL1zqUXZ_1sd9VkiclOaNCA7F1G500ZcqGuBTdf_riB3JZPKSmVoToDJHNDn7dmVzzFntWgNe5pC4_00fwqceRKblDbeLSiuds May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:41.720774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a4f0b9e4c81c44f1acb872b59b7a7ba0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 33ce280e0216416988a350cf28e764df May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-734770359", "metadata": {"Type": "work"}}} May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: May 23 10:57:41.722344 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-734770359', 'metadata': {'Type': 'work'}}}} May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise error May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi '#$%' May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:41.723395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 10:57:41.725484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 10:57:41.726974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 10:57:41.726974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.726974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-856fa70c-cd62-4481-a308-8656862c359f tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:41.726974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-856fa70c-cd62-4481-a308-8656862c359f tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.248946 May 23 10:57:41.726974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 368/722] 10.222.0.36 () {60 vars in 1155 bytes} [Mon May 23 10:57:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 10:57:41.734611 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5028e34d-72cc-42ff-98fc-4b7d43bd9433 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Action: 'create', calling method: .version_select at 0x7fe71b79fa60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1304801659", "metadata": {"Type": "work"}}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5028e34d-72cc-42ff-98fc-4b7d43bd9433 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Request method failure captured: May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 120 May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2il-BXDk1qnpwPNVCsrIfBaycHNZ45hle44dduyOUMDyBk7tnxqddEcwO9AZ1HW0lTHvBVDVIPJMUL1zqUXZ_1sd9VkiclOaNCA7F1G500ZcqGuBTdf_riB3JZPKSmVoToDJHNDn7dmVzzFntWgNe5pC4_00fwqceRKblDbeLSiuds May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:41.738122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a4f0b9e4c81c44f1acb872b59b7a7ba0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 33ce280e0216416988a350cf28e764df May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1304801659", "metadata": {"Type": "work"}}} May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: May 23 10:57:41.740292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1304801659', 'metadata': {'Type': 'work'}}}} May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise error May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi '0' May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:41.741229 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 10:57:41.743413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 10:57:41.745757 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 10:57:41.745757 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.745757 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5028e34d-72cc-42ff-98fc-4b7d43bd9433 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:41.745757 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5028e34d-72cc-42ff-98fc-4b7d43bd9433 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009880 May 23 10:57:41.745757 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 355/723] 10.222.0.36 () {60 vars in 1155 bytes} [Mon May 23 10:57:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 23 10:57:41.751463 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-535a5ae3-de46-4435-8c59-d5f6cc5f45a3 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Action: 'create', calling method: .version_select at 0x7fe71b7f9310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1606413929", "metadata": {"Type": "work"}}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-535a5ae3-de46-4435-8c59-d5f6cc5f45a3 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Request method failure captured: May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 119 May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2il-BXDk1qnpwPNVCsrIfBaycHNZ45hle44dduyOUMDyBk7tnxqddEcwO9AZ1HW0lTHvBVDVIPJMUL1zqUXZ_1sd9VkiclOaNCA7F1G500ZcqGuBTdf_riB3JZPKSmVoToDJHNDn7dmVzzFntWgNe5pC4_00fwqceRKblDbeLSiuds May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:41.754817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a4f0b9e4c81c44f1acb872b59b7a7ba0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 33ce280e0216416988a350cf28e764df May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1606413929", "metadata": {"Type": "work"}}} May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: May 23 10:57:41.756332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1606413929', 'metadata': {'Type': 'work'}}}} May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise error May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi '' May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:41.757389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 10:57:41.759061 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 10:57:41.760260 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 10:57:41.760260 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.760260 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-535a5ae3-de46-4435-8c59-d5f6cc5f45a3 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:41.760260 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-535a5ae3-de46-4435-8c59-d5f6cc5f45a3 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011559 May 23 10:57:41.760260 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 369/724] 10.222.0.36 () {60 vars in 1155 bytes} [Mon May 23 10:57:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 10:57:41.768941 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-95d89316-7f34-4622-b4c2-c1dbec2cc66b tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Calling method '.version_select at 0x7fe71b781c10>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:41.800721 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-95d89316-7f34-4622-b4c2-c1dbec2cc66b tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] HTTP exception thrown: Volume tempest-invalid-2046883152 could not be found. May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-95d89316-7f34-4622-b4c2-c1dbec2cc66b tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Request method failure captured: May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2046883152 HTTP/1.1 May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2il-BXDk1qnpwPNVCsrIfBaycHNZ45hle44dduyOUMDyBk7tnxqddEcwO9AZ1HW0lTHvBVDVIPJMUL1zqUXZ_1sd9VkiclOaNCA7F1G500ZcqGuBTdf_riB3JZPKSmVoToDJHNDn7dmVzzFntWgNe5pC4_00fwqceRKblDbeLSiuds May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:41.803236 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a4f0b9e4c81c44f1acb872b59b7a7ba0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 33ce280e0216416988a350cf28e764df May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Volume tempest-invalid-2046883152 could not be found. May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'tempest-invalid-2046883152'} May 23 10:57:41.804814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2046883152 could not be found. (HTTP 404) (Request-ID: req-e8718200-ea78-42ec-9939-004c05e461bb) May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.805750 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 10:57:41.807217 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2046883152 could not be found. May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:41.808561 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2046883152 could not be found. May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2046883152 could not be found. May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-95d89316-7f34-4622-b4c2-c1dbec2cc66b tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Returning 404 to user: Volume tempest-invalid-2046883152 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-95d89316-7f34-4622-b4c2-c1dbec2cc66b tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2046883152" status: 404 len: 99 microversion: 2.1 time: 0.039546 May 23 10:57:41.810710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 356/725] 10.222.0.36 () {58 vars in 1217 bytes} [Mon May 23 10:57:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2046883152 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 23 10:57:41.818589 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ccd7b8b5-0d2d-46e0-9956-ca60f6980d18 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003776 May 23 10:57:41.819089 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 370/726] 10.222.0.36 () {58 vars in 1139 bytes} [Mon May 23 10:57:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 10:57:41.828390 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4a93c1d7-39ac-4d34-b398-b162b00d2b49 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004016 May 23 10:57:41.833990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 357/727] 10.222.0.36 () {58 vars in 1136 bytes} [Mon May 23 10:57:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 10:57:41.839026 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3c44e553-7d03-4970-acad-51148ad2a765 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Calling method '.version_select at 0x7fe72002bf70>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:41.868272 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-3c44e553-7d03-4970-acad-51148ad2a765 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] HTTP exception thrown: Volume aac7d842-8872-4931-aeb1-cf1d90dced06 could not be found. May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3c44e553-7d03-4970-acad-51148ad2a765 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Request method failure captured: May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/os-volumes/aac7d842-8872-4931-aeb1-cf1d90dced06 HTTP/1.1 May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2il-BXDk1qnpwPNVCsrIfBaycHNZ45hle44dduyOUMDyBk7tnxqddEcwO9AZ1HW0lTHvBVDVIPJMUL1zqUXZ_1sd9VkiclOaNCA7F1G500ZcqGuBTdf_riB3JZPKSmVoToDJHNDn7dmVzzFntWgNe5pC4_00fwqceRKblDbeLSiuds May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:41.870322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a4f0b9e4c81c44f1acb872b59b7a7ba0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 33ce280e0216416988a350cf28e764df May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Volume aac7d842-8872-4931-aeb1-cf1d90dced06 could not be found. May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'aac7d842-8872-4931-aeb1-cf1d90dced06'} May 23 10:57:41.871672 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aac7d842-8872-4931-aeb1-cf1d90dced06 could not be found. (HTTP 404) (Request-ID: req-f32dd479-5c37-45dc-bf26-a597b3595f3a) May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.872512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 10:57:41.874443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aac7d842-8872-4931-aeb1-cf1d90dced06 could not be found. May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 10:57:41.876037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aac7d842-8872-4931-aeb1-cf1d90dced06 could not be found. May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aac7d842-8872-4931-aeb1-cf1d90dced06 could not be found. May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3c44e553-7d03-4970-acad-51148ad2a765 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Returning 404 to user: Volume aac7d842-8872-4931-aeb1-cf1d90dced06 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3c44e553-7d03-4970-acad-51148ad2a765 tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/aac7d842-8872-4931-aeb1-cf1d90dced06" status: 404 len: 109 microversion: 2.1 time: 0.036916 May 23 10:57:41.877628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 371/728] 10.222.0.36 () {58 vars in 1247 bytes} [Mon May 23 10:57:41 2022] DELETE /compute/v2.1/os-volumes/aac7d842-8872-4931-aeb1-cf1d90dced06 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:41.882187 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-dadc5311-fef4-432f-ad9f-2dfe40ec966d tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Calling method '.version_select at 0x7fe7200c1d30>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:41.910001 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-dadc5311-fef4-432f-ad9f-2dfe40ec966d tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] HTTP exception thrown: Volume 4032abdd-3ee1-4681-8ea3-d5a0def487e5 could not be found. May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-dadc5311-fef4-432f-ad9f-2dfe40ec966d tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Request method failure captured: May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/os-volumes/4032abdd-3ee1-4681-8ea3-d5a0def487e5 HTTP/1.1 May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2il-BXDk1qnpwPNVCsrIfBaycHNZ45hle44dduyOUMDyBk7tnxqddEcwO9AZ1HW0lTHvBVDVIPJMUL1zqUXZ_1sd9VkiclOaNCA7F1G500ZcqGuBTdf_riB3JZPKSmVoToDJHNDn7dmVzzFntWgNe5pC4_00fwqceRKblDbeLSiuds May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:41.912494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a4f0b9e4c81c44f1acb872b59b7a7ba0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a4f0b9e4c81c44f1acb872b59b7a7ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: a4f0b9e4c81c44f1acb872b59b7a7ba0 May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-VolumesNegativeTest-1237774395 May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 33ce280e0216416988a350cf28e764df May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-VolumesNegativeTest-1237774395-project May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Volume 4032abdd-3ee1-4681-8ea3-d5a0def487e5 could not be found. May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': '4032abdd-3ee1-4681-8ea3-d5a0def487e5'} May 23 10:57:41.913807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4032abdd-3ee1-4681-8ea3-d5a0def487e5 could not be found. (HTTP 404) (Request-ID: req-ea41b2a3-85a7-4c8e-9e9f-5ca61cb0cf76) May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.915062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 10:57:41.916645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4032abdd-3ee1-4681-8ea3-d5a0def487e5 could not be found. May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 10:57:41.918995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4032abdd-3ee1-4681-8ea3-d5a0def487e5 could not be found. May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4032abdd-3ee1-4681-8ea3-d5a0def487e5 could not be found. May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-dadc5311-fef4-432f-ad9f-2dfe40ec966d tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] Returning 404 to user: Volume 4032abdd-3ee1-4681-8ea3-d5a0def487e5 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-dadc5311-fef4-432f-ad9f-2dfe40ec966d tempest-VolumesNegativeTest-1237774395 tempest-VolumesNegativeTest-1237774395-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/4032abdd-3ee1-4681-8ea3-d5a0def487e5" status: 404 len: 109 microversion: 2.1 time: 0.035559 May 23 10:57:41.920626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 358/729] 10.222.0.36 () {58 vars in 1244 bytes} [Mon May 23 10:57:41 2022] GET /compute/v2.1/os-volumes/4032abdd-3ee1-4681-8ea3-d5a0def487e5 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:57:42.651508 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1211644026", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "networks": [{"uuid": "cc8d7747-304f-4d2e-8f87-f8242319b6e5"}]}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:42.707437 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] validate_networks() for [('cc8d7747-304f-4d2e-8f87-f8242319b6e5', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:57:43.450886 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:57:43.451986 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:57:43.452747 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:57:43.453162 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:57:43.453660 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:57:43.463924 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:43.464584 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:43.465547 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:43.466022 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:43.485928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Getting quotas for project 0efd7c9275cf43b0b7c31325840a35b2. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:57:43.490112 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Getting quotas for user 8e9c10838f2f42a1bf94679dfbfa7a69 and project 0efd7c9275cf43b0b7c31325840a35b2. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:57:43.501676 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:57:43.504295 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:57:43.555450 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5d8b4b1b-5c4c-448a-946d-4a7d3f57fc89 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911210 May 23 10:57:43.556469 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 372/730] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:57:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:57:43.568528 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e6a160cb-b9c3-4d01-9663-821f94bf286c tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:43.569762 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e6a160cb-b9c3-4d01-9663-821f94bf286c tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:43.572737 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:43.694575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e6a160cb-b9c3-4d01-9663-821f94bf286c tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:43.702496 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e6a160cb-b9c3-4d01-9663-821f94bf286c tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1214 microversion: 2.1 time: 0.139709 May 23 10:57:43.703062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 359/731] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:43 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:44.722796 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b6b99ca8-e7fc-43af-917b-b96c372b9758 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:44.724415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b6b99ca8-e7fc-43af-917b-b96c372b9758 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:44.734809 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:44.737415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b6b99ca8-e7fc-43af-917b-b96c372b9758 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:44.739369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b6b99ca8-e7fc-43af-917b-b96c372b9758 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:44.741094 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b6b99ca8-e7fc-43af-917b-b96c372b9758 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:44.743560 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b6b99ca8-e7fc-43af-917b-b96c372b9758 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:44.858542 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b6b99ca8-e7fc-43af-917b-b96c372b9758 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:44.872912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b6b99ca8-e7fc-43af-917b-b96c372b9758 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1274 microversion: 2.1 time: 0.155949 May 23 10:57:44.873788 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 373/732] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:44 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1274 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:45.890863 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-86885293-5a97-4b80-bcf7-4300dc9cff69 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:45.891462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-86885293-5a97-4b80-bcf7-4300dc9cff69 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:45.900048 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86885293-5a97-4b80-bcf7-4300dc9cff69 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:45.900726 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86885293-5a97-4b80-bcf7-4300dc9cff69 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:45.901683 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86885293-5a97-4b80-bcf7-4300dc9cff69 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:45.902171 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-86885293-5a97-4b80-bcf7-4300dc9cff69 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:46.004170 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-86885293-5a97-4b80-bcf7-4300dc9cff69 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:46.012647 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-86885293-5a97-4b80-bcf7-4300dc9cff69 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1272 microversion: 2.1 time: 0.125373 May 23 10:57:46.013295 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 360/733] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:45 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:47.029866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-307d5d96-2062-42aa-9552-7c6fb31e46f6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:47.030522 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-307d5d96-2062-42aa-9552-7c6fb31e46f6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:47.040320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-307d5d96-2062-42aa-9552-7c6fb31e46f6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:47.040761 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-307d5d96-2062-42aa-9552-7c6fb31e46f6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:47.041707 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-307d5d96-2062-42aa-9552-7c6fb31e46f6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:47.042327 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-307d5d96-2062-42aa-9552-7c6fb31e46f6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:47.135555 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-a17cf11a-40d5-4065-83ca-f3d99f5ca207 req-02c391f4-5b67-4f2a-849a-a1a178afe101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c7a661-9bcf-4352-aee2-6a26239e2caf", "tag": "fa3837d4-0777-47fd-af4d-b4898cca6b74"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:47.153893 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-a17cf11a-40d5-4065-83ca-f3d99f5ca207 req-02c391f4-5b67-4f2a-849a-a1a178afe101 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:47.154606 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-a17cf11a-40d5-4065-83ca-f3d99f5ca207 req-02c391f4-5b67-4f2a-849a-a1a178afe101 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:47.168696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-a17cf11a-40d5-4065-83ca-f3d99f5ca207 req-02c391f4-5b67-4f2a-849a-a1a178afe101 service nova] Creating event network-changed:fa3837d4-0777-47fd-af4d-b4898cca6b74 for instance 61c7a661-9bcf-4352-aee2-6a26239e2caf on hv-cinder-83699 May 23 10:57:47.175314 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-a17cf11a-40d5-4065-83ca-f3d99f5ca207 req-02c391f4-5b67-4f2a-849a-a1a178afe101 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046762 May 23 10:57:47.177245 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 361/734] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:57:47.221774 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-307d5d96-2062-42aa-9552-7c6fb31e46f6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:47.230338 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-307d5d96-2062-42aa-9552-7c6fb31e46f6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1314 microversion: 2.1 time: 0.204301 May 23 10:57:47.230911 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 374/735] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:47 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:48.248058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-79895506-3837-40bc-a03a-2db8ea6eaeee tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:48.248774 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-79895506-3837-40bc-a03a-2db8ea6eaeee tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:48.255416 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-79895506-3837-40bc-a03a-2db8ea6eaeee tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:48.256070 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-79895506-3837-40bc-a03a-2db8ea6eaeee tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:48.256995 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-79895506-3837-40bc-a03a-2db8ea6eaeee tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:48.257578 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-79895506-3837-40bc-a03a-2db8ea6eaeee tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:48.480160 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-79895506-3837-40bc-a03a-2db8ea6eaeee tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:48.487471 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-79895506-3837-40bc-a03a-2db8ea6eaeee tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1314 microversion: 2.1 time: 0.244088 May 23 10:57:48.488061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 362/736] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:48 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:49.407909 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ad6c8b09-f342-44dc-a146-3d608b95084e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:49.409618 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ad6c8b09-f342-44dc-a146-3d608b95084e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:49.416211 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ad6c8b09-f342-44dc-a146-3d608b95084e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:49.416667 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ad6c8b09-f342-44dc-a146-3d608b95084e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:49.417488 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ad6c8b09-f342-44dc-a146-3d608b95084e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:49.417918 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ad6c8b09-f342-44dc-a146-3d608b95084e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:49.447805 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ad6c8b09-f342-44dc-a146-3d608b95084e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044460 May 23 10:57:49.448315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 375/737] 10.222.0.36 () {60 vars in 1342 bytes} [Mon May 23 10:57:49 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:49.515783 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1a469f3f-d50a-4b4e-9617-ab551a74b427 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:49.516938 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1a469f3f-d50a-4b4e-9617-ab551a74b427 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:49.518804 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d43be44d-1412-40fd-bc62-9d733f68cc9e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:49.519304 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d43be44d-1412-40fd-bc62-9d733f68cc9e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:49.524389 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1a469f3f-d50a-4b4e-9617-ab551a74b427 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:49.524840 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1a469f3f-d50a-4b4e-9617-ab551a74b427 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:49.525651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1a469f3f-d50a-4b4e-9617-ab551a74b427 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:49.526112 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1a469f3f-d50a-4b4e-9617-ab551a74b427 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:49.527380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d43be44d-1412-40fd-bc62-9d733f68cc9e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:49.528325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d43be44d-1412-40fd-bc62-9d733f68cc9e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:49.529316 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d43be44d-1412-40fd-bc62-9d733f68cc9e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:49.530074 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d43be44d-1412-40fd-bc62-9d733f68cc9e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:49.559529 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d43be44d-1412-40fd-bc62-9d733f68cc9e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:57:49.659876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d43be44d-1412-40fd-bc62-9d733f68cc9e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 204 len: 0 microversion: 2.20 time: 0.144431 May 23 10:57:49.660513 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 376/738] 10.222.0.36 () {60 vars in 1279 bytes} [Mon May 23 10:57:49 2022] DELETE /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 23 10:57:49.674423 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-aa615ed9-21e9-440f-b735-e4471cbfb197 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:49.678770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-aa615ed9-21e9-440f-b735-e4471cbfb197 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:49.687554 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa615ed9-21e9-440f-b735-e4471cbfb197 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:49.688253 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa615ed9-21e9-440f-b735-e4471cbfb197 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:49.689304 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa615ed9-21e9-440f-b735-e4471cbfb197 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:49.689750 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aa615ed9-21e9-440f-b735-e4471cbfb197 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:49.712596 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1a469f3f-d50a-4b4e-9617-ab551a74b427 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:49.721807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1a469f3f-d50a-4b4e-9617-ab551a74b427 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1314 microversion: 2.1 time: 0.211920 May 23 10:57:49.724572 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 363/739] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:49 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:49.878195 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-aa615ed9-21e9-440f-b735-e4471cbfb197 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:49.890465 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-aa615ed9-21e9-440f-b735-e4471cbfb197 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:49.892829 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-aa615ed9-21e9-440f-b735-e4471cbfb197 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:49.894611 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-aa615ed9-21e9-440f-b735-e4471cbfb197 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.225616 May 23 10:57:49.897689 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 377/740] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:49 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:57:50.740102 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-541f89e1-1074-4652-a5d4-ec81405e00f1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:50.740720 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-541f89e1-1074-4652-a5d4-ec81405e00f1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:50.747182 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-541f89e1-1074-4652-a5d4-ec81405e00f1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:50.747633 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-541f89e1-1074-4652-a5d4-ec81405e00f1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:50.748405 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-541f89e1-1074-4652-a5d4-ec81405e00f1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:50.748843 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-541f89e1-1074-4652-a5d4-ec81405e00f1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:50.889579 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-541f89e1-1074-4652-a5d4-ec81405e00f1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:50.897624 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-541f89e1-1074-4652-a5d4-ec81405e00f1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1314 microversion: 2.1 time: 0.161823 May 23 10:57:50.898227 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 364/741] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:50 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:50.922313 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0aaa38cd-183e-43c2-ac21-b915d01c7fc2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:50.923444 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-0aaa38cd-183e-43c2-ac21-b915d01c7fc2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:50.931913 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0aaa38cd-183e-43c2-ac21-b915d01c7fc2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:50.931913 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0aaa38cd-183e-43c2-ac21-b915d01c7fc2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:50.932475 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0aaa38cd-183e-43c2-ac21-b915d01c7fc2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:50.932923 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0aaa38cd-183e-43c2-ac21-b915d01c7fc2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:51.129349 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-0aaa38cd-183e-43c2-ac21-b915d01c7fc2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:51.137559 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-0aaa38cd-183e-43c2-ac21-b915d01c7fc2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:51.139105 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-0aaa38cd-183e-43c2-ac21-b915d01c7fc2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:51.140266 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-0aaa38cd-183e-43c2-ac21-b915d01c7fc2 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1724 microversion: 2.20 time: 0.222274 May 23 10:57:51.141038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 378/742] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:50 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:57:51.913887 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-cc2c69ee-a1d9-4b75-b956-42465f938cce tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:51.915182 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-cc2c69ee-a1d9-4b75-b956-42465f938cce tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:51.921909 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cc2c69ee-a1d9-4b75-b956-42465f938cce tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:51.922599 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cc2c69ee-a1d9-4b75-b956-42465f938cce tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:51.923156 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cc2c69ee-a1d9-4b75-b956-42465f938cce tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:51.923615 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cc2c69ee-a1d9-4b75-b956-42465f938cce tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:52.148235 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-cc2c69ee-a1d9-4b75-b956-42465f938cce tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:52.159843 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-856f3b7e-0db8-4c6c-aec0-1802a3583091 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:52.161885 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-856f3b7e-0db8-4c6c-aec0-1802a3583091 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:52.168355 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-856f3b7e-0db8-4c6c-aec0-1802a3583091 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:52.168811 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-856f3b7e-0db8-4c6c-aec0-1802a3583091 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:52.169746 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-856f3b7e-0db8-4c6c-aec0-1802a3583091 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:52.170342 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-856f3b7e-0db8-4c6c-aec0-1802a3583091 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:52.178001 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-cc2c69ee-a1d9-4b75-b956-42465f938cce tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1314 microversion: 2.1 time: 0.268024 May 23 10:57:52.178598 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 365/743] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:51 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:52.254663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-856f3b7e-0db8-4c6c-aec0-1802a3583091 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:52.263087 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-856f3b7e-0db8-4c6c-aec0-1802a3583091 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:52.264590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-856f3b7e-0db8-4c6c-aec0-1802a3583091 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:52.265792 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-856f3b7e-0db8-4c6c-aec0-1802a3583091 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1657 microversion: 2.20 time: 0.110093 May 23 10:57:52.266681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 379/744] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:52 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1657 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 10:57:52.350953 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-ffbb859a-88be-49b4-ae0b-10eb968d044e req-1692cae6-a8e0-428f-9d76-5d162a92005c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde224c6-c41a-4424-8bc4-bd8f62d9fa53", "name": "network-vif-deleted", "tag": "40b35beb-6f47-44de-835b-56925cd7ae0f"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:52.361099 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-ffbb859a-88be-49b4-ae0b-10eb968d044e req-1692cae6-a8e0-428f-9d76-5d162a92005c service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:52.361547 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-ffbb859a-88be-49b4-ae0b-10eb968d044e req-1692cae6-a8e0-428f-9d76-5d162a92005c service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:52.539179 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-ffbb859a-88be-49b4-ae0b-10eb968d044e req-1692cae6-a8e0-428f-9d76-5d162a92005c service nova] Creating event network-vif-deleted:40b35beb-6f47-44de-835b-56925cd7ae0f for instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 on hv-cinder-83699 May 23 10:57:52.544344 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-ffbb859a-88be-49b4-ae0b-10eb968d044e req-1692cae6-a8e0-428f-9d76-5d162a92005c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198160 May 23 10:57:52.544980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 366/745] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:53.195334 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ede23f06-d478-4e70-bdf1-64428e7e3ecb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:53.195902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ede23f06-d478-4e70-bdf1-64428e7e3ecb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:53.202814 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ede23f06-d478-4e70-bdf1-64428e7e3ecb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:53.203271 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ede23f06-d478-4e70-bdf1-64428e7e3ecb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:53.204050 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ede23f06-d478-4e70-bdf1-64428e7e3ecb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:53.204496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ede23f06-d478-4e70-bdf1-64428e7e3ecb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:53.287870 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-32de5948-966e-4e58-816c-2d30086c36f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:53.288667 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-32de5948-966e-4e58-816c-2d30086c36f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:53.297360 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-32de5948-966e-4e58-816c-2d30086c36f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:53.298274 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-32de5948-966e-4e58-816c-2d30086c36f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:53.299140 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-32de5948-966e-4e58-816c-2d30086c36f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:53.299655 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-32de5948-966e-4e58-816c-2d30086c36f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:53.346179 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ede23f06-d478-4e70-bdf1-64428e7e3ecb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:53.355088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ede23f06-d478-4e70-bdf1-64428e7e3ecb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1314 microversion: 2.1 time: 0.163631 May 23 10:57:53.361173 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 380/746] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:53 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:53.371826 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-32de5948-966e-4e58-816c-2d30086c36f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:53.382123 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-32de5948-966e-4e58-816c-2d30086c36f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:53.383611 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-32de5948-966e-4e58-816c-2d30086c36f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:53.384906 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-32de5948-966e-4e58-816c-2d30086c36f8 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1657 microversion: 2.20 time: 0.103750 May 23 10:57:53.385591 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 367/747] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:53 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1657 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:57:54.372714 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-25ca5623-39c4-4ecd-a4e5-db7fa3591304 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:54.373325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-25ca5623-39c4-4ecd-a4e5-db7fa3591304 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:54.375343 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:54.376021 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=6 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:54.382540 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-25ca5623-39c4-4ecd-a4e5-db7fa3591304 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:54.382990 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-25ca5623-39c4-4ecd-a4e5-db7fa3591304 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:54.383762 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-25ca5623-39c4-4ecd-a4e5-db7fa3591304 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:54.384196 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-25ca5623-39c4-4ecd-a4e5-db7fa3591304 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:54.389877 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:54.403424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:54.404184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:54.407388 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:54.412622 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:54.413152 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:54.414128 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:54.414632 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:54.460611 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:54.461059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:54.462517 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lazy-loading 'fault' on Instance uuid bde224c6-c41a-4424-8bc4-bd8f62d9fa53 {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:57:54.470256 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:57:54.508446 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:54.518944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:54.521390 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7433cc7ed66f4e609332c56c936487e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c669b26bf1845a6a3b35eb551ebcb98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:54.523445 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-aff49a70-b196-4ab8-b44e-e5e4e25b6e0e tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 200 len: 1372 microversion: 2.20 time: 0.123853 May 23 10:57:54.524407 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 368/748] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:54 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 10:57:54.527624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-25ca5623-39c4-4ecd-a4e5-db7fa3591304 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:54.535019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-25ca5623-39c4-4ecd-a4e5-db7fa3591304 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1314 microversion: 2.1 time: 0.166328 May 23 10:57:54.536314 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 381/749] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:54 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:54.891251 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-14c40052-4d4b-4e78-8c93-91189022d7aa req-56541982-f3e1-4f7f-81f8-16bf546d891e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c7a661-9bcf-4352-aee2-6a26239e2caf", "name": "network-vif-plugged", "status": "completed", "tag": "fa3837d4-0777-47fd-af4d-b4898cca6b74"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:54.901044 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-14c40052-4d4b-4e78-8c93-91189022d7aa req-56541982-f3e1-4f7f-81f8-16bf546d891e service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:54.901492 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-14c40052-4d4b-4e78-8c93-91189022d7aa req-56541982-f3e1-4f7f-81f8-16bf546d891e service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:54.915020 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-14c40052-4d4b-4e78-8c93-91189022d7aa req-56541982-f3e1-4f7f-81f8-16bf546d891e service nova] Creating event network-vif-plugged:fa3837d4-0777-47fd-af4d-b4898cca6b74 for instance 61c7a661-9bcf-4352-aee2-6a26239e2caf on hv-cinder-83699 May 23 10:57:54.919942 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-14c40052-4d4b-4e78-8c93-91189022d7aa req-56541982-f3e1-4f7f-81f8-16bf546d891e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179501 May 23 10:57:54.920534 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 369/750] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:55.542859 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-99b61c36-109a-42ad-86b4-afa3a3575efc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:55.543474 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-99b61c36-109a-42ad-86b4-afa3a3575efc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:55.550124 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99b61c36-109a-42ad-86b4-afa3a3575efc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:55.550579 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99b61c36-109a-42ad-86b4-afa3a3575efc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:55.551850 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99b61c36-109a-42ad-86b4-afa3a3575efc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:55.552289 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99b61c36-109a-42ad-86b4-afa3a3575efc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:55.553639 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-307e21c8-75ea-4a87-9f43-70ae50c258c6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:55.554447 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-307e21c8-75ea-4a87-9f43-70ae50c258c6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:55.561026 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-307e21c8-75ea-4a87-9f43-70ae50c258c6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:55.561475 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-307e21c8-75ea-4a87-9f43-70ae50c258c6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:55.562279 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-307e21c8-75ea-4a87-9f43-70ae50c258c6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:55.562722 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-307e21c8-75ea-4a87-9f43-70ae50c258c6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:55.565817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-99b61c36-109a-42ad-86b4-afa3a3575efc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] HTTP exception thrown: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-99b61c36-109a-42ad-86b4-afa3a3575efc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Request method failure captured: May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 HTTP/1.1 May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGQ-taUV273wcrPo7QFxmjbMSZe3CFgxNJ6WMkptLf_Uo47YaiNZ7DXCC_9KnxOh7uxvoca5-HrzbclkVhwcBHKXVyI1AjQJbIWIncRdEHpd-JGN07y58jfbBxrETtCfRz6vT-nYumCl4C7Ce85TdEpvKWe66rVyuDE-y0_Ox-wLc May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Openstack-Nova-Api-Version: 2.20 May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:55.568103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2c669b26bf1845a6a3b35eb551ebcb98", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 7433cc7ed66f4e609332c56c936487e8 May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:55.569770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'bde224c6-c41a-4424-8bc4-bd8f62d9fa53'} May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:55.570957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:55.572402 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:55.573810 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-99b61c36-109a-42ad-86b4-afa3a3575efc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Returning 404 to user: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:55.573810 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-99b61c36-109a-42ad-86b4-afa3a3575efc tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 404 len: 111 microversion: 2.20 time: 0.030526 May 23 10:57:55.573810 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 382/751] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:55 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 10:57:55.578226 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-628e2932-d517-4ea9-9f1a-6480944f9121 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '.version_select at 0x7fe7200aaee0>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:55.603094 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-628e2932-d517-4ea9-9f1a-6480944f9121 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1265172538" status: 204 len: 0 microversion: 2.20 time: 0.028240 May 23 10:57:55.603838 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 383/752] 10.222.0.36 () {60 vars in 1261 bytes} [Mon May 23 10:57:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1265172538 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 10:57:55.711699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-307e21c8-75ea-4a87-9f43-70ae50c258c6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:55.719212 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-307e21c8-75ea-4a87-9f43-70ae50c258c6 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1314 microversion: 2.1 time: 0.170348 May 23 10:57:55.719714 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 370/753] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:55 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:57:56.737142 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-883f3009-1470-4e39-b7aa-604a35f3eb5a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:56.737783 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-883f3009-1470-4e39-b7aa-604a35f3eb5a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:56.746114 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-883f3009-1470-4e39-b7aa-604a35f3eb5a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:56.746594 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-883f3009-1470-4e39-b7aa-604a35f3eb5a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:56.747604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-883f3009-1470-4e39-b7aa-604a35f3eb5a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:56.748192 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-883f3009-1470-4e39-b7aa-604a35f3eb5a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:56.886043 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-883f3009-1470-4e39-b7aa-604a35f3eb5a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:56.893536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-883f3009-1470-4e39-b7aa-604a35f3eb5a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1498 microversion: 2.1 time: 0.160776 May 23 10:57:56.894118 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 384/754] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:56 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:57.371895 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b76d2d83-83a0-49bb-9b34-962c73361e79 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:57.372394 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b76d2d83-83a0-49bb-9b34-962c73361e79 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:57.381002 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b76d2d83-83a0-49bb-9b34-962c73361e79 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:57.381465 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b76d2d83-83a0-49bb-9b34-962c73361e79 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:57.382265 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b76d2d83-83a0-49bb-9b34-962c73361e79 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:57.382878 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b76d2d83-83a0-49bb-9b34-962c73361e79 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:57.408681 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b76d2d83-83a0-49bb-9b34-962c73361e79 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Going to try to terminate instance {{(pid=129030) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:57:57.486471 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b76d2d83-83a0-49bb-9b34-962c73361e79 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "DELETE /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 204 len: 0 microversion: 2.1 time: 0.117981 May 23 10:57:57.487477 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 371/755] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:57:57 2022] DELETE /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:57:57.511372 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2a1c910b-e036-4119-9b58-0e7db86ff240 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:57.511372 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2a1c910b-e036-4119-9b58-0e7db86ff240 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:57.516090 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2a1c910b-e036-4119-9b58-0e7db86ff240 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:57.516666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2a1c910b-e036-4119-9b58-0e7db86ff240 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:57.518709 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2a1c910b-e036-4119-9b58-0e7db86ff240 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:57.519227 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2a1c910b-e036-4119-9b58-0e7db86ff240 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:57.536841 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f37cc028-9f40-46f8-8a6b-23685e71bc1d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:57.537668 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f37cc028-9f40-46f8-8a6b-23685e71bc1d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:57.545719 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f37cc028-9f40-46f8-8a6b-23685e71bc1d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:57.546516 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f37cc028-9f40-46f8-8a6b-23685e71bc1d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:57.547441 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f37cc028-9f40-46f8-8a6b-23685e71bc1d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:57.547976 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f37cc028-9f40-46f8-8a6b-23685e71bc1d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:57.564262 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-f37cc028-9f40-46f8-8a6b-23685e71bc1d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] HTTP exception thrown: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f37cc028-9f40-46f8-8a6b-23685e71bc1d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Request method failure captured: May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: DELETE /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 HTTP/1.1 May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dGQ-taUV273wcrPo7QFxmjbMSZe3CFgxNJ6WMkptLf_Uo47YaiNZ7DXCC_9KnxOh7uxvoca5-HrzbclkVhwcBHKXVyI1AjQJbIWIncRdEHpd-JGN07y58jfbBxrETtCfRz6vT-nYumCl4C7Ce85TdEpvKWe66rVyuDE-y0_Ox-wLc May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Openstack-Nova-Api-Version: 2.20 May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:57.566225 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2c669b26bf1845a6a3b35eb551ebcb98", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 7433cc7ed66f4e609332c56c936487e8 May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:57.567916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'bde224c6-c41a-4424-8bc4-bd8f62d9fa53'} May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:57.568789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:57.570237 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:57.571736 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f37cc028-9f40-46f8-8a6b-23685e71bc1d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Returning 404 to user: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:57.573398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f37cc028-9f40-46f8-8a6b-23685e71bc1d tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 404 len: 111 microversion: 2.20 time: 0.040578 May 23 10:57:57.573398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 372/756] 10.222.0.36 () {60 vars in 1279 bytes} [Mon May 23 10:57:57 2022] DELETE /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 10:57:57.584850 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3925f863-98e5-48ba-a390-5946f70bd899 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:57.585614 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3925f863-98e5-48ba-a390-5946f70bd899 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: bde224c6-c41a-4424-8bc4-bd8f62d9fa53] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:57.591872 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3925f863-98e5-48ba-a390-5946f70bd899 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:57.592411 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3925f863-98e5-48ba-a390-5946f70bd899 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:57.593260 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3925f863-98e5-48ba-a390-5946f70bd899 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:57.593885 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3925f863-98e5-48ba-a390-5946f70bd899 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:57.611304 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-3925f863-98e5-48ba-a390-5946f70bd899 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] HTTP exception thrown: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3925f863-98e5-48ba-a390-5946f70bd899 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Request method failure captured: May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 HTTP/1.1 May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2dGQ-taUV273wcrPo7QFxmjbMSZe3CFgxNJ6WMkptLf_Uo47YaiNZ7DXCC_9KnxOh7uxvoca5-HrzbclkVhwcBHKXVyI1AjQJbIWIncRdEHpd-JGN07y58jfbBxrETtCfRz6vT-nYumCl4C7Ce85TdEpvKWe66rVyuDE-y0_Ox-wLc May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Openstack-Nova-Api-Version: 2.20 May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 10:57:57.612960 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2c669b26bf1845a6a3b35eb551ebcb98", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 7433cc7ed66f4e609332c56c936487e8 May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:57.615575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'bde224c6-c41a-4424-8bc4-bd8f62d9fa53'} May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:57.616705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. May 23 10:57:57.618124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 10:57:57.619757 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3925f863-98e5-48ba-a390-5946f70bd899 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Returning 404 to user: Instance bde224c6-c41a-4424-8bc4-bd8f62d9fa53 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:57.619757 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3925f863-98e5-48ba-a390-5946f70bd899 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53" status: 404 len: 111 microversion: 2.20 time: 0.034991 May 23 10:57:57.621388 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 373/757] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:57 2022] GET /compute/v2.1/servers/bde224c6-c41a-4424-8bc4-bd8f62d9fa53 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 10:57:57.678640 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2a1c910b-e036-4119-9b58-0e7db86ff240 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:57.687208 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2a1c910b-e036-4119-9b58-0e7db86ff240 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1504 microversion: 2.1 time: 0.193735 May 23 10:57:57.688336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 385/758] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:57 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:58.704341 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5ce3ad72-97d4-4d1f-8f68-a063b9fcb90f tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:58.705067 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5ce3ad72-97d4-4d1f-8f68-a063b9fcb90f tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:58.711677 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5ce3ad72-97d4-4d1f-8f68-a063b9fcb90f tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:58.712199 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5ce3ad72-97d4-4d1f-8f68-a063b9fcb90f tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:58.713034 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5ce3ad72-97d4-4d1f-8f68-a063b9fcb90f tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:58.713589 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5ce3ad72-97d4-4d1f-8f68-a063b9fcb90f tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:58.779449 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ff4b21fb-ad84-4fea-b1d3-54cea7d0648c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:58.780541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ff4b21fb-ad84-4fea-b1d3-54cea7d0648c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:58.788733 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ff4b21fb-ad84-4fea-b1d3-54cea7d0648c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:58.789275 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ff4b21fb-ad84-4fea-b1d3-54cea7d0648c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:58.790387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ff4b21fb-ad84-4fea-b1d3-54cea7d0648c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:58.791192 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ff4b21fb-ad84-4fea-b1d3-54cea7d0648c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:58.810842 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-ff4b21fb-ad84-4fea-b1d3-54cea7d0648c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] HTTP exception thrown: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ff4b21fb-ad84-4fea-b1d3-54cea7d0648c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Request method failure captured: May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a HTTP/1.1 May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGQ-taUV273wcrPo7QFxmjbMSZe3CFgxNJ6WMkptLf_Uo47YaiNZ7DXCC_9KnxOh7uxvoca5-HrzbclkVhwcBHKXVyI1AjQJbIWIncRdEHpd-JGN07y58jfbBxrETtCfRz6vT-nYumCl4C7Ce85TdEpvKWe66rVyuDE-y0_Ox-wLc May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Openstack-Nova-Api-Version: 2.20 May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:58.812686 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2c669b26bf1845a6a3b35eb551ebcb98", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 7433cc7ed66f4e609332c56c936487e8 May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:57:58.814526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '1e61941d-0058-4809-83b9-676d70df112a'} May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:58.815602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:57:58.817246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:58.819438 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ff4b21fb-ad84-4fea-b1d3-54cea7d0648c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Returning 404 to user: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:58.820617 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ff4b21fb-ad84-4fea-b1d3-54cea7d0648c tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 404 len: 111 microversion: 2.20 time: 0.045228 May 23 10:57:58.821678 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 386/759] 10.222.0.36 () {60 vars in 1279 bytes} [Mon May 23 10:57:58 2022] DELETE /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 10:57:58.830383 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-886fe4c4-7e9c-4140-8371-95617c949743 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:58.831042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-886fe4c4-7e9c-4140-8371-95617c949743 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] [instance: 1e61941d-0058-4809-83b9-676d70df112a] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:58.844974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-886fe4c4-7e9c-4140-8371-95617c949743 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:58.845589 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-886fe4c4-7e9c-4140-8371-95617c949743 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:58.846490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-886fe4c4-7e9c-4140-8371-95617c949743 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:58.846928 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-886fe4c4-7e9c-4140-8371-95617c949743 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:58.861704 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-886fe4c4-7e9c-4140-8371-95617c949743 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] HTTP exception thrown: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-886fe4c4-7e9c-4140-8371-95617c949743 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Request method failure captured: May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a HTTP/1.1 May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2dGQ-taUV273wcrPo7QFxmjbMSZe3CFgxNJ6WMkptLf_Uo47YaiNZ7DXCC_9KnxOh7uxvoca5-HrzbclkVhwcBHKXVyI1AjQJbIWIncRdEHpd-JGN07y58jfbBxrETtCfRz6vT-nYumCl4C7Ce85TdEpvKWe66rVyuDE-y0_Ox-wLc May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Openstack-Nova-Api-Version: 2.20 May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:57:58.864238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2c669b26bf1845a6a3b35eb551ebcb98", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2c669b26bf1845a6a3b35eb551ebcb98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 2c669b26bf1845a6a3b35eb551ebcb98 May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-360517298 May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 7433cc7ed66f4e609332c56c936487e8 May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-360517298-project May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:57:58.865604 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '1e61941d-0058-4809-83b9-676d70df112a'} May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:57:58.866387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. May 23 10:57:58.867597 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:57:58.868731 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-886fe4c4-7e9c-4140-8371-95617c949743 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] Returning 404 to user: Instance 1e61941d-0058-4809-83b9-676d70df112a could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:57:58.868731 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-886fe4c4-7e9c-4140-8371-95617c949743 tempest-AttachVolumeShelveTestJSON-360517298 tempest-AttachVolumeShelveTestJSON-360517298-project] 10.222.0.36 "GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a" status: 404 len: 111 microversion: 2.20 time: 0.039355 May 23 10:57:58.868731 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 387/760] 10.222.0.36 () {60 vars in 1276 bytes} [Mon May 23 10:57:58 2022] GET /compute/v2.1/servers/1e61941d-0058-4809-83b9-676d70df112a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 10:57:58.896697 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5ce3ad72-97d4-4d1f-8f68-a063b9fcb90f tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:57:58.904368 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5ce3ad72-97d4-4d1f-8f68-a063b9fcb90f tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1504 microversion: 2.1 time: 0.203763 May 23 10:57:58.914421 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 374/761] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:58 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:57:59.908682 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-ebe829fd-e025-4b0b-955c-eb95258525fc req-ce855663-b2b3-4463-9c48-12a1a86302c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c7a661-9bcf-4352-aee2-6a26239e2caf", "name": "network-vif-deleted", "tag": "fa3837d4-0777-47fd-af4d-b4898cca6b74"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:57:59.918525 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-ebe829fd-e025-4b0b-955c-eb95258525fc req-ce855663-b2b3-4463-9c48-12a1a86302c2 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:59.919414 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-ebe829fd-e025-4b0b-955c-eb95258525fc req-ce855663-b2b3-4463-9c48-12a1a86302c2 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:59.928751 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5608d920-4d7e-4c0e-8704-4e1641926628 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:57:59.932768 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5608d920-4d7e-4c0e-8704-4e1641926628 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:57:59.937628 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-ebe829fd-e025-4b0b-955c-eb95258525fc req-ce855663-b2b3-4463-9c48-12a1a86302c2 service nova] Creating event network-vif-deleted:fa3837d4-0777-47fd-af4d-b4898cca6b74 for instance 61c7a661-9bcf-4352-aee2-6a26239e2caf on hv-cinder-83699 May 23 10:57:59.941726 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-ebe829fd-e025-4b0b-955c-eb95258525fc req-ce855663-b2b3-4463-9c48-12a1a86302c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036137 May 23 10:57:59.946753 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 388/762] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:57:59.956816 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5608d920-4d7e-4c0e-8704-4e1641926628 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:59.958104 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5608d920-4d7e-4c0e-8704-4e1641926628 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:57:59.959286 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5608d920-4d7e-4c0e-8704-4e1641926628 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:57:59.960231 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5608d920-4d7e-4c0e-8704-4e1641926628 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:00.064134 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5608d920-4d7e-4c0e-8704-4e1641926628 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:00.073474 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5608d920-4d7e-4c0e-8704-4e1641926628 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 200 len: 1299 microversion: 2.1 time: 0.155799 May 23 10:58:00.074765 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 375/763] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:57:59 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:58:01.092141 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-99418183-f4fb-473d-86c9-273e260ce79d tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:01.092986 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-99418183-f4fb-473d-86c9-273e260ce79d tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 61c7a661-9bcf-4352-aee2-6a26239e2caf] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:01.107652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99418183-f4fb-473d-86c9-273e260ce79d tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:01.108468 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99418183-f4fb-473d-86c9-273e260ce79d tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:01.109631 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99418183-f4fb-473d-86c9-273e260ce79d tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:01.110361 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-99418183-f4fb-473d-86c9-273e260ce79d tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:01.144898 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-99418183-f4fb-473d-86c9-273e260ce79d tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] HTTP exception thrown: Instance 61c7a661-9bcf-4352-aee2-6a26239e2caf could not be found. May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-99418183-f4fb-473d-86c9-273e260ce79d tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Request method failure captured: May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf HTTP/1.1 May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2ik6h9vj0lJEzXBGi743M1cLBtylJ0Xg9_FvtrdKB16-LoAwUDBWuViGAf3PoJ_nfGp9s5XuyFEFHyq02MkP9Jj2zkXodgua_OyadhMi-aj0U2ejw2PFRUxKVAOm4ZniQ3hjdJtlPt24aMkuLylEezXHcjbFdor-EDFnzS4ZGNkbG0 May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 0efd7c9275cf43b0b7c31325840a35b2 May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesActionsTest-796767071 May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:58:01.147170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0efd7c9275cf43b0b7c31325840a35b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0efd7c9275cf43b0b7c31325840a35b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0efd7c9275cf43b0b7c31325840a35b2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0efd7c9275cf43b0b7c31325840a35b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesActionsTest-796767071 May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 0efd7c9275cf43b0b7c31325840a35b2 May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesActionsTest-796767071 May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesActionsTest-796767071-project May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 8e9c10838f2f42a1bf94679dfbfa7a69 May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesActionsTest-796767071-project May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 61c7a661-9bcf-4352-aee2-6a26239e2caf could not be found. May 23 10:58:01.148570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '61c7a661-9bcf-4352-aee2-6a26239e2caf'} May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c7a661-9bcf-4352-aee2-6a26239e2caf could not be found. May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:58:01.149385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c7a661-9bcf-4352-aee2-6a26239e2caf could not be found. May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c7a661-9bcf-4352-aee2-6a26239e2caf could not be found. May 23 10:58:01.150681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:58:01.153186 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-99418183-f4fb-473d-86c9-273e260ce79d tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Returning 404 to user: Instance 61c7a661-9bcf-4352-aee2-6a26239e2caf could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:58:01.154092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-99418183-f4fb-473d-86c9-273e260ce79d tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf" status: 404 len: 111 microversion: 2.1 time: 0.066561 May 23 10:58:01.156186 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 389/764] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:01 2022] GET /compute/v2.1/servers/61c7a661-9bcf-4352-aee2-6a26239e2caf => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:58:01.288629 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1060848619", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "networks": [{"uuid": "cc8d7747-304f-4d2e-8f87-f8242319b6e5"}]}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:58:01.347844 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.network.neutron [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] validate_networks() for [('cc8d7747-304f-4d2e-8f87-f8242319b6e5', None, None, None, None, None)] {{(pid=129030) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:58:02.016196 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Flavor limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:58:02.016631 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Image limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:58:02.017116 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Flavor pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:58:02.017533 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Image pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:58:02.018222 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:58:02.029091 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:02.029660 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:02.044362 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:02.048167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:02.081535 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Getting quotas for project 0efd7c9275cf43b0b7c31325840a35b2. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:58:02.087580 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Getting quotas for user 8e9c10838f2f42a1bf94679dfbfa7a69 and project 0efd7c9275cf43b0b7c31325840a35b2. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:58:02.101606 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Going to run 1 instances... {{(pid=129030) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:58:02.105344 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:58:02.172480 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ac6467a0-4406-45f2-a266-3b302008aba2 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888519 May 23 10:58:02.178576 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 376/765] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:58:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:58:02.186476 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6cc05a44-5bf1-43a0-a713-2b4de24c21f3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:02.188167 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6cc05a44-5bf1-43a0-a713-2b4de24c21f3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:02.277009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6cc05a44-5bf1-43a0-a713-2b4de24c21f3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:02.294218 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6cc05a44-5bf1-43a0-a713-2b4de24c21f3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1214 microversion: 2.1 time: 0.114082 May 23 10:58:02.295081 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 390/766] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:02 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:03.311899 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0cbc92cb-5f73-497f-b5e5-00bdf93d7ed1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:03.314471 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0cbc92cb-5f73-497f-b5e5-00bdf93d7ed1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:03.325376 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0cbc92cb-5f73-497f-b5e5-00bdf93d7ed1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:03.326223 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0cbc92cb-5f73-497f-b5e5-00bdf93d7ed1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:03.327502 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0cbc92cb-5f73-497f-b5e5-00bdf93d7ed1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:03.328139 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0cbc92cb-5f73-497f-b5e5-00bdf93d7ed1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:03.409500 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0cbc92cb-5f73-497f-b5e5-00bdf93d7ed1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:03.422548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0cbc92cb-5f73-497f-b5e5-00bdf93d7ed1 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1266 microversion: 2.1 time: 0.114893 May 23 10:58:03.423819 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 377/767] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:03 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:58:04.443215 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1abb5a15-ebcf-4178-9c08-538c72f42abc tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:04.444019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1abb5a15-ebcf-4178-9c08-538c72f42abc tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:04.471365 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1abb5a15-ebcf-4178-9c08-538c72f42abc tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:04.472541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1abb5a15-ebcf-4178-9c08-538c72f42abc tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:04.475214 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1abb5a15-ebcf-4178-9c08-538c72f42abc tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:04.475655 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1abb5a15-ebcf-4178-9c08-538c72f42abc tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:04.717666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1abb5a15-ebcf-4178-9c08-538c72f42abc tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:04.726712 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1abb5a15-ebcf-4178-9c08-538c72f42abc tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1314 microversion: 2.1 time: 0.289595 May 23 10:58:04.728643 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 391/768] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:04 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:05.302214 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-474198d5-e5fe-4511-9c1b-f705d290c12c req-f5d8e1e5-b6fa-44ad-912e-c93fcb56f3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838bbed2-53ea-46d7-a84e-d01ed959c3a0", "tag": "1b62b795-0b13-4a4e-9b24-c418669033e6"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:58:05.322372 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-474198d5-e5fe-4511-9c1b-f705d290c12c req-f5d8e1e5-b6fa-44ad-912e-c93fcb56f3d2 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:05.323449 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-474198d5-e5fe-4511-9c1b-f705d290c12c req-f5d8e1e5-b6fa-44ad-912e-c93fcb56f3d2 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:05.336705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-474198d5-e5fe-4511-9c1b-f705d290c12c req-f5d8e1e5-b6fa-44ad-912e-c93fcb56f3d2 service nova] Creating event network-changed:1b62b795-0b13-4a4e-9b24-c418669033e6 for instance 838bbed2-53ea-46d7-a84e-d01ed959c3a0 on hv-cinder-83699 May 23 10:58:05.341586 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-474198d5-e5fe-4511-9c1b-f705d290c12c req-f5d8e1e5-b6fa-44ad-912e-c93fcb56f3d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043215 May 23 10:58:05.342737 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 378/769] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:58:05.760019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-14d40da2-ec6a-422b-8858-1b1e7c19048e tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:05.760019 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-14d40da2-ec6a-422b-8858-1b1e7c19048e tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:05.770284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-14d40da2-ec6a-422b-8858-1b1e7c19048e tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:05.771117 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-14d40da2-ec6a-422b-8858-1b1e7c19048e tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:05.774860 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-14d40da2-ec6a-422b-8858-1b1e7c19048e tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:05.775445 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-14d40da2-ec6a-422b-8858-1b1e7c19048e tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:05.961828 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-14d40da2-ec6a-422b-8858-1b1e7c19048e tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:05.971005 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-14d40da2-ec6a-422b-8858-1b1e7c19048e tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1314 microversion: 2.1 time: 0.229951 May 23 10:58:05.971450 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 392/770] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:05 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:06.988935 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2667fe3d-f0e3-476b-8e12-c5aaaa52ae01 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:06.989733 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2667fe3d-f0e3-476b-8e12-c5aaaa52ae01 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:06.996848 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2667fe3d-f0e3-476b-8e12-c5aaaa52ae01 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:06.997856 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2667fe3d-f0e3-476b-8e12-c5aaaa52ae01 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:06.999028 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2667fe3d-f0e3-476b-8e12-c5aaaa52ae01 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:06.999836 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2667fe3d-f0e3-476b-8e12-c5aaaa52ae01 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:07.242359 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2667fe3d-f0e3-476b-8e12-c5aaaa52ae01 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:07.255889 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2667fe3d-f0e3-476b-8e12-c5aaaa52ae01 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1314 microversion: 2.1 time: 0.268321 May 23 10:58:07.257721 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 379/771] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:06 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:08.273872 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-434f468c-b28a-4c70-8078-4515236f0cc8 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:08.274546 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-434f468c-b28a-4c70-8078-4515236f0cc8 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:08.281189 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-434f468c-b28a-4c70-8078-4515236f0cc8 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:08.281639 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-434f468c-b28a-4c70-8078-4515236f0cc8 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:08.282445 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-434f468c-b28a-4c70-8078-4515236f0cc8 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:08.282890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-434f468c-b28a-4c70-8078-4515236f0cc8 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:08.419031 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-434f468c-b28a-4c70-8078-4515236f0cc8 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:08.426996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-434f468c-b28a-4c70-8078-4515236f0cc8 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1314 microversion: 2.1 time: 0.157850 May 23 10:58:08.427867 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 393/772] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:08 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:08.801309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-37b6dba9-0276-44ef-ba3c-92edfbd2784c req-4480a358-a6a4-4cb6-b33e-4d49ae41fde3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838bbed2-53ea-46d7-a84e-d01ed959c3a0", "name": "network-vif-plugged", "status": "completed", "tag": "1b62b795-0b13-4a4e-9b24-c418669033e6"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:58:08.811986 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-37b6dba9-0276-44ef-ba3c-92edfbd2784c req-4480a358-a6a4-4cb6-b33e-4d49ae41fde3 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:08.814782 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-37b6dba9-0276-44ef-ba3c-92edfbd2784c req-4480a358-a6a4-4cb6-b33e-4d49ae41fde3 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:08.832986 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-37b6dba9-0276-44ef-ba3c-92edfbd2784c req-4480a358-a6a4-4cb6-b33e-4d49ae41fde3 service nova] Creating event network-vif-plugged:1b62b795-0b13-4a4e-9b24-c418669033e6 for instance 838bbed2-53ea-46d7-a84e-d01ed959c3a0 on hv-cinder-83699 May 23 10:58:08.843465 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-37b6dba9-0276-44ef-ba3c-92edfbd2784c req-4480a358-a6a4-4cb6-b33e-4d49ae41fde3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045714 May 23 10:58:08.844078 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 380/773] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:58:09.445368 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5a39f927-d516-4673-96c9-569a7e7e888a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:09.446158 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5a39f927-d516-4673-96c9-569a7e7e888a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:09.460134 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5a39f927-d516-4673-96c9-569a7e7e888a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:09.461225 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5a39f927-d516-4673-96c9-569a7e7e888a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:09.462303 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5a39f927-d516-4673-96c9-569a7e7e888a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:09.464097 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5a39f927-d516-4673-96c9-569a7e7e888a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:09.669982 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5a39f927-d516-4673-96c9-569a7e7e888a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:09.679167 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5a39f927-d516-4673-96c9-569a7e7e888a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1314 microversion: 2.1 time: 0.237870 May 23 10:58:09.679743 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 394/774] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:09 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:10.697524 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-77dc03cb-7c0f-4f74-9141-df4dd40a6089 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:10.698562 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-77dc03cb-7c0f-4f74-9141-df4dd40a6089 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:10.705790 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-77dc03cb-7c0f-4f74-9141-df4dd40a6089 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:10.706453 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-77dc03cb-7c0f-4f74-9141-df4dd40a6089 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:10.707557 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-77dc03cb-7c0f-4f74-9141-df4dd40a6089 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:10.708175 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-77dc03cb-7c0f-4f74-9141-df4dd40a6089 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:10.854456 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-77dc03cb-7c0f-4f74-9141-df4dd40a6089 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:10.862654 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-77dc03cb-7c0f-4f74-9141-df4dd40a6089 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1314 microversion: 2.1 time: 0.169602 May 23 10:58:10.863881 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 381/775] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:10 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:11.881338 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a5699957-09d4-4e21-ab10-eee18bc79284 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:11.882136 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a5699957-09d4-4e21-ab10-eee18bc79284 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:11.893930 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a5699957-09d4-4e21-ab10-eee18bc79284 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:11.895921 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a5699957-09d4-4e21-ab10-eee18bc79284 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:11.896800 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a5699957-09d4-4e21-ab10-eee18bc79284 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:11.899729 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a5699957-09d4-4e21-ab10-eee18bc79284 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:12.086327 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a5699957-09d4-4e21-ab10-eee18bc79284 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:12.097589 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a5699957-09d4-4e21-ab10-eee18bc79284 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1314 microversion: 2.1 time: 0.220844 May 23 10:58:12.098855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 395/776] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:11 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:13.116157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-cf6df435-3136-414c-adbf-4f98d4fe182a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:13.117797 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-cf6df435-3136-414c-adbf-4f98d4fe182a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:13.120810 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:58:13.122074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=6 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:58:13.130331 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cf6df435-3136-414c-adbf-4f98d4fe182a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:13.131047 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cf6df435-3136-414c-adbf-4f98d4fe182a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:13.133621 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cf6df435-3136-414c-adbf-4f98d4fe182a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:13.134658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-cf6df435-3136-414c-adbf-4f98d4fe182a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:13.435307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-cf6df435-3136-414c-adbf-4f98d4fe182a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:13.450536 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-cf6df435-3136-414c-adbf-4f98d4fe182a tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1314 microversion: 2.1 time: 0.337888 May 23 10:58:13.452127 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 382/777] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:13 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:14.470799 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-214441f5-cb10-440a-9a81-d6c328a9bb26 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:14.471322 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-214441f5-cb10-440a-9a81-d6c328a9bb26 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:14.473870 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:58:14.490636 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-214441f5-cb10-440a-9a81-d6c328a9bb26 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:14.492113 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-214441f5-cb10-440a-9a81-d6c328a9bb26 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:14.493489 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-214441f5-cb10-440a-9a81-d6c328a9bb26 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:14.495431 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-214441f5-cb10-440a-9a81-d6c328a9bb26 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:14.790960 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-214441f5-cb10-440a-9a81-d6c328a9bb26 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:14.816842 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-214441f5-cb10-440a-9a81-d6c328a9bb26 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1498 microversion: 2.1 time: 0.338929 May 23 10:58:14.817618 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 396/778] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:14 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1498 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:15.565978 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9b4d3d07-410a-43ed-9e76-de5e8af63622 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:15.568465 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9b4d3d07-410a-43ed-9e76-de5e8af63622 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:15.576556 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:58:15.578714 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9b4d3d07-410a-43ed-9e76-de5e8af63622 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:15.579340 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9b4d3d07-410a-43ed-9e76-de5e8af63622 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:15.580483 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9b4d3d07-410a-43ed-9e76-de5e8af63622 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:15.581051 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9b4d3d07-410a-43ed-9e76-de5e8af63622 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:15.614600 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9b4d3d07-410a-43ed-9e76-de5e8af63622 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Going to try to terminate instance {{(pid=129030) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 10:58:15.774296 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9b4d3d07-410a-43ed-9e76-de5e8af63622 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "DELETE /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 204 len: 0 microversion: 2.1 time: 0.206968 May 23 10:58:15.775688 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 383/779] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 10:58:15 2022] DELETE /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 10:58:15.796077 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-7c3a635d-9ecf-4f11-8a99-6886bb27350b tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:15.797424 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-7c3a635d-9ecf-4f11-8a99-6886bb27350b tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:15.817625 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:58:15.823821 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7c3a635d-9ecf-4f11-8a99-6886bb27350b tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:15.832243 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7c3a635d-9ecf-4f11-8a99-6886bb27350b tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:15.832903 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7c3a635d-9ecf-4f11-8a99-6886bb27350b tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:15.833353 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7c3a635d-9ecf-4f11-8a99-6886bb27350b tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:16.185432 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-7c3a635d-9ecf-4f11-8a99-6886bb27350b tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:16.198334 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-7c3a635d-9ecf-4f11-8a99-6886bb27350b tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1504 microversion: 2.1 time: 0.416285 May 23 10:58:16.199217 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 397/780] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:15 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:17.219998 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3e71d3ec-cd13-43b4-8bf1-b757eae7ddc5 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:17.221803 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3e71d3ec-cd13-43b4-8bf1-b757eae7ddc5 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:17.233577 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3e71d3ec-cd13-43b4-8bf1-b757eae7ddc5 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:17.237004 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3e71d3ec-cd13-43b4-8bf1-b757eae7ddc5 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:17.240700 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3e71d3ec-cd13-43b4-8bf1-b757eae7ddc5 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:17.241734 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3e71d3ec-cd13-43b4-8bf1-b757eae7ddc5 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:17.620546 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3e71d3ec-cd13-43b4-8bf1-b757eae7ddc5 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:17.634052 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3e71d3ec-cd13-43b4-8bf1-b757eae7ddc5 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1504 microversion: 2.1 time: 0.419584 May 23 10:58:17.634577 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 384/781] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:17 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1504 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:18.111162 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-931e0e67-d4a8-42f7-9561-7fcd36b7026b req-3518ebfb-cab1-4784-8eed-1434b5d7e5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838bbed2-53ea-46d7-a84e-d01ed959c3a0", "name": "network-vif-deleted", "tag": "1b62b795-0b13-4a4e-9b24-c418669033e6"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:58:18.120994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-931e0e67-d4a8-42f7-9561-7fcd36b7026b req-3518ebfb-cab1-4784-8eed-1434b5d7e5f7 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:18.121876 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-931e0e67-d4a8-42f7-9561-7fcd36b7026b req-3518ebfb-cab1-4784-8eed-1434b5d7e5f7 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:18.136483 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-931e0e67-d4a8-42f7-9561-7fcd36b7026b req-3518ebfb-cab1-4784-8eed-1434b5d7e5f7 service nova] Creating event network-vif-deleted:1b62b795-0b13-4a4e-9b24-c418669033e6 for instance 838bbed2-53ea-46d7-a84e-d01ed959c3a0 on hv-cinder-83699 May 23 10:58:18.142688 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-931e0e67-d4a8-42f7-9561-7fcd36b7026b req-3518ebfb-cab1-4784-8eed-1434b5d7e5f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035164 May 23 10:58:18.143594 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 398/782] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:58:18.653794 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:18.655511 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:18.666246 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:18.667122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:18.668497 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:18.669179 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:18.752865 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:18.755094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:18.755713 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lazy-loading 'fault' on Instance uuid 838bbed2-53ea-46d7-a84e-d01ed959c3a0 {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 10:58:18.764876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:58:18.830188 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9c10838f2f42a1bf94679dfbfa7a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efd7c9275cf43b0b7c31325840a35b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:58:18.863969 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-54dd8d05-7fc2-4d00-80cb-dded0886bfcb tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 200 len: 1304 microversion: 2.1 time: 0.215063 May 23 10:58:18.866141 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 385/783] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:18 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 1304 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:58:19.885205 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8b8688a3-6634-4353-af0a-9466babb99e3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:58:19.885940 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-8b8688a3-6634-4353-af0a-9466babb99e3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] [instance: 838bbed2-53ea-46d7-a84e-d01ed959c3a0] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:58:19.910987 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8b8688a3-6634-4353-af0a-9466babb99e3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:19.911464 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8b8688a3-6634-4353-af0a-9466babb99e3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:19.912254 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8b8688a3-6634-4353-af0a-9466babb99e3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:58:19.912733 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8b8688a3-6634-4353-af0a-9466babb99e3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:58:19.974222 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-8b8688a3-6634-4353-af0a-9466babb99e3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] HTTP exception thrown: Instance 838bbed2-53ea-46d7-a84e-d01ed959c3a0 could not be found. May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8b8688a3-6634-4353-af0a-9466babb99e3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Request method failure captured: May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 HTTP/1.1 May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2ik6h9vj0lJEzXBGi743M1cLBtylJ0Xg9_FvtrdKB16-LoAwUDBWuViGAf3PoJ_nfGp9s5XuyFEFHyq02MkP9Jj2zkXodgua_OyadhMi-aj0U2ejw2PFRUxKVAOm4ZniQ3hjdJtlPt24aMkuLylEezXHcjbFdor-EDFnzS4ZGNkbG0 May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 0efd7c9275cf43b0b7c31325840a35b2 May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesActionsTest-796767071 May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 10:58:19.975931 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0efd7c9275cf43b0b7c31325840a35b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0efd7c9275cf43b0b7c31325840a35b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0efd7c9275cf43b0b7c31325840a35b2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0efd7c9275cf43b0b7c31325840a35b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesActionsTest-796767071 May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 0efd7c9275cf43b0b7c31325840a35b2 May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesActionsTest-796767071 May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesActionsTest-796767071-project May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 8e9c10838f2f42a1bf94679dfbfa7a69 May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesActionsTest-796767071-project May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 838bbed2-53ea-46d7-a84e-d01ed959c3a0 could not be found. May 23 10:58:19.977328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '838bbed2-53ea-46d7-a84e-d01ed959c3a0'} May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 838bbed2-53ea-46d7-a84e-d01ed959c3a0 could not be found. May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 10:58:19.978269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 838bbed2-53ea-46d7-a84e-d01ed959c3a0 could not be found. May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 838bbed2-53ea-46d7-a84e-d01ed959c3a0 could not be found. May 23 10:58:19.979666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 10:58:19.980941 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8b8688a3-6634-4353-af0a-9466babb99e3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] Returning 404 to user: Instance 838bbed2-53ea-46d7-a84e-d01ed959c3a0 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 10:58:19.980941 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-8b8688a3-6634-4353-af0a-9466babb99e3 tempest-VolumesActionsTest-796767071 tempest-VolumesActionsTest-796767071-project] 10.222.0.36 "GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0" status: 404 len: 111 microversion: 2.1 time: 0.098521 May 23 10:58:19.993518 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 399/784] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:58:19 2022] GET /compute/v2.1/servers/838bbed2-53ea-46d7-a84e-d01ed959c3a0 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 10:58:23.917636 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-acaf3d33-9d8c-485e-a895-db5e07216e2a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Action: 'create', calling method: .version_select at 0x7fe720021ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-637878101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGH1LrmAvFOYo++4khGQxIKhr8t5SturWpTfRUriPoqlRxnMs2YCSauUYXhebDLhtS6kfeWO6pPldPlCps0QYg4PzZ4VHemMnanQOYlJ6sMUijfs21t2cI8Td0LvG6XiQ=="}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:58:23.951672 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-acaf3d33-9d8c-485e-a895-db5e07216e2a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Getting quotas for project c085ae456b46460ea86e4cf1dfd819c2. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:58:23.955575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-acaf3d33-9d8c-485e-a895-db5e07216e2a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Getting quotas for user 43568344bfa54dd7a6b2cb5fe34422d7 and project c085ae456b46460ea86e4cf1dfd819c2. Resources: {'key_pairs'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:58:23.987023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-acaf3d33-9d8c-485e-a895-db5e07216e2a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.257798 May 23 10:58:23.988385 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 386/785] 10.222.0.36 () {60 vars in 1158 bytes} [Mon May 23 10:58:23 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:58:59.289377 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1943957319", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-637878101", "security_groups": [{"name": "tempest-secgroup-smoke-1502757534"}], "networks": [{"uuid": "90371d46-3dad-489b-a6d5-e38e362157d4"}], "block_device_mapping_v2": [{"uuid": "38a58f8d-986c-4031-b711-d8f717b62694", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:58:59.302716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=5 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:58:59.303854 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=72 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:58:59.416482 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] validate_networks() for [('90371d46-3dad-489b-a6d5-e38e362157d4', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:59:00.133311 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:59:00.133739 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:59:00.134239 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:59:00.134681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:59:00.135096 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:59:00.145270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:00.146189 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:00.147012 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:00.147589 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:00.164847 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Getting quotas for project c085ae456b46460ea86e4cf1dfd819c2. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:59:00.168957 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Getting quotas for user 43568344bfa54dd7a6b2cb5fe34422d7 and project c085ae456b46460ea86e4cf1dfd819c2. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:59:00.236757 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:59:00.239824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38a58f8d-986c-4031-b711-d8f717b62694',volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:59:00.381701 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-38fc8ba8-2934-4eec-ac99-3dd467cf8d90 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.096821 May 23 10:59:00.382765 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 400/786] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:58:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 10:59:00.390506 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:00.391479 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=4 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:00.392430 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:00.404711 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-05798210-da7b-41fa-9e3a-2960a9f96798 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:00.405563 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-05798210-da7b-41fa-9e3a-2960a9f96798 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:00.469024 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-05798210-da7b-41fa-9e3a-2960a9f96798 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:00.477148 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-05798210-da7b-41fa-9e3a-2960a9f96798 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1088 microversion: 2.1 time: 0.088093 May 23 10:59:00.477732 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 387/787] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:00 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1088 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:01.496030 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-56d835b8-19bf-4229-b1d9-0c1bf6cbdce5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:01.496741 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-56d835b8-19bf-4229-b1d9-0c1bf6cbdce5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:01.503470 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-56d835b8-19bf-4229-b1d9-0c1bf6cbdce5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:01.504239 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-56d835b8-19bf-4229-b1d9-0c1bf6cbdce5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:01.505166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-56d835b8-19bf-4229-b1d9-0c1bf6cbdce5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:01.505756 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-56d835b8-19bf-4229-b1d9-0c1bf6cbdce5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:01.607501 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-56d835b8-19bf-4229-b1d9-0c1bf6cbdce5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:01.621893 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-56d835b8-19bf-4229-b1d9-0c1bf6cbdce5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1186 microversion: 2.1 time: 0.130978 May 23 10:59:01.623570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 401/788] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:01 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1186 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:02.642380 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-da57c821-6214-420e-8bdf-41c2cb317db3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:02.643111 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-da57c821-6214-420e-8bdf-41c2cb317db3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:02.656193 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-da57c821-6214-420e-8bdf-41c2cb317db3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:02.657094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-da57c821-6214-420e-8bdf-41c2cb317db3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:02.658335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-da57c821-6214-420e-8bdf-41c2cb317db3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:02.662683 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-da57c821-6214-420e-8bdf-41c2cb317db3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:03.005971 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-da57c821-6214-420e-8bdf-41c2cb317db3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:03.019202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-da57c821-6214-420e-8bdf-41c2cb317db3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1272 microversion: 2.1 time: 0.381701 May 23 10:59:03.019905 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 388/789] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:02 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1272 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:03.487369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-d963314e-1a44-46d7-962c-acfa145e4d76 req-0f703a2b-eefd-467b-9b28-35ce3c384711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b27c20-a6cd-4dd3-9506-1d132be6e635", "tag": "28a6a33f-244e-40a2-b8a1-14db1a5fb3ba"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:59:03.511719 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-d963314e-1a44-46d7-962c-acfa145e4d76 req-0f703a2b-eefd-467b-9b28-35ce3c384711 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:03.512663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-d963314e-1a44-46d7-962c-acfa145e4d76 req-0f703a2b-eefd-467b-9b28-35ce3c384711 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:03.539872 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-d963314e-1a44-46d7-962c-acfa145e4d76 req-0f703a2b-eefd-467b-9b28-35ce3c384711 service nova] Creating event network-changed:28a6a33f-244e-40a2-b8a1-14db1a5fb3ba for instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 on hv-cinder-83699 May 23 10:59:03.556182 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-d963314e-1a44-46d7-962c-acfa145e4d76 req-0f703a2b-eefd-467b-9b28-35ce3c384711 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078171 May 23 10:59:03.558558 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 402/790] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:59:04.036487 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b2969f9b-312f-48d2-818e-840f32e269d3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:04.037108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b2969f9b-312f-48d2-818e-840f32e269d3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:04.043780 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b2969f9b-312f-48d2-818e-840f32e269d3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:04.044260 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b2969f9b-312f-48d2-818e-840f32e269d3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:04.045037 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b2969f9b-312f-48d2-818e-840f32e269d3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:04.045473 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b2969f9b-312f-48d2-818e-840f32e269d3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:04.179721 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b2969f9b-312f-48d2-818e-840f32e269d3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:04.187211 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b2969f9b-312f-48d2-818e-840f32e269d3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.154520 May 23 10:59:04.187780 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 389/791] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:04 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:05.205064 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a4fc65b9-64c7-4197-9fda-3fbd2adcafd8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:05.205843 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a4fc65b9-64c7-4197-9fda-3fbd2adcafd8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:05.213411 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a4fc65b9-64c7-4197-9fda-3fbd2adcafd8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:05.214281 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a4fc65b9-64c7-4197-9fda-3fbd2adcafd8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:05.215587 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a4fc65b9-64c7-4197-9fda-3fbd2adcafd8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:05.216284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a4fc65b9-64c7-4197-9fda-3fbd2adcafd8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:05.404924 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a4fc65b9-64c7-4197-9fda-3fbd2adcafd8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:05.414724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a4fc65b9-64c7-4197-9fda-3fbd2adcafd8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.213215 May 23 10:59:05.416309 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 403/792] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:05 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:06.434611 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a4245915-1026-4f6b-9393-6f4ff688ee24 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:06.436321 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a4245915-1026-4f6b-9393-6f4ff688ee24 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:06.442956 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4245915-1026-4f6b-9393-6f4ff688ee24 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:06.443678 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4245915-1026-4f6b-9393-6f4ff688ee24 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:06.444461 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4245915-1026-4f6b-9393-6f4ff688ee24 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:06.445845 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a4245915-1026-4f6b-9393-6f4ff688ee24 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:06.652893 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a4245915-1026-4f6b-9393-6f4ff688ee24 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:06.662122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a4245915-1026-4f6b-9393-6f4ff688ee24 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.233136 May 23 10:59:06.663028 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 390/793] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:06 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:07.678916 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0a375bb0-af64-490f-afd2-426d7c6732b5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:07.680133 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-0a375bb0-af64-490f-afd2-426d7c6732b5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:07.686575 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0a375bb0-af64-490f-afd2-426d7c6732b5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:07.687065 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0a375bb0-af64-490f-afd2-426d7c6732b5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:07.687839 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0a375bb0-af64-490f-afd2-426d7c6732b5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:07.688284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0a375bb0-af64-490f-afd2-426d7c6732b5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:07.831218 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-0a375bb0-af64-490f-afd2-426d7c6732b5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:07.839907 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-0a375bb0-af64-490f-afd2-426d7c6732b5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.164753 May 23 10:59:07.840488 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 404/794] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:07 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:08.857793 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-3179c28e-bdc0-4a99-a153-abccd7fd763d tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:08.859126 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-3179c28e-bdc0-4a99-a153-abccd7fd763d tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:08.866414 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3179c28e-bdc0-4a99-a153-abccd7fd763d tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:08.866870 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3179c28e-bdc0-4a99-a153-abccd7fd763d tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:08.867664 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3179c28e-bdc0-4a99-a153-abccd7fd763d tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:08.868116 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-3179c28e-bdc0-4a99-a153-abccd7fd763d tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:09.021606 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-3179c28e-bdc0-4a99-a153-abccd7fd763d tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:09.029578 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-3179c28e-bdc0-4a99-a153-abccd7fd763d tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.175947 May 23 10:59:09.030178 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 391/795] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:08 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:10.048292 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e377ae17-904d-4071-a57a-c766ef9ad5a5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:10.049078 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e377ae17-904d-4071-a57a-c766ef9ad5a5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:10.056748 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e377ae17-904d-4071-a57a-c766ef9ad5a5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:10.057724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e377ae17-904d-4071-a57a-c766ef9ad5a5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:10.058263 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e377ae17-904d-4071-a57a-c766ef9ad5a5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:10.058841 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e377ae17-904d-4071-a57a-c766ef9ad5a5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:10.159655 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:10.176027 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=6 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:10.212652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e377ae17-904d-4071-a57a-c766ef9ad5a5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:10.220652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e377ae17-904d-4071-a57a-c766ef9ad5a5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.176442 May 23 10:59:10.221221 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 405/796] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:10 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:11.236798 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-01563bfb-36de-445c-9ad4-65ed429fe6f8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:11.237481 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-01563bfb-36de-445c-9ad4-65ed429fe6f8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:11.240240 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:11.250498 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-01563bfb-36de-445c-9ad4-65ed429fe6f8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:11.250961 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-01563bfb-36de-445c-9ad4-65ed429fe6f8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:11.251757 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-01563bfb-36de-445c-9ad4-65ed429fe6f8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:11.252202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-01563bfb-36de-445c-9ad4-65ed429fe6f8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:11.390531 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-01563bfb-36de-445c-9ad4-65ed429fe6f8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:11.399811 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-01563bfb-36de-445c-9ad4-65ed429fe6f8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.167090 May 23 10:59:11.400553 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 392/797] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:11 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:12.417104 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-40218734-2718-419c-87a5-c08cdbf94877 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:12.417705 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-40218734-2718-419c-87a5-c08cdbf94877 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:12.424879 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-40218734-2718-419c-87a5-c08cdbf94877 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:12.425600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-40218734-2718-419c-87a5-c08cdbf94877 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:12.426453 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-40218734-2718-419c-87a5-c08cdbf94877 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:12.427036 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-40218734-2718-419c-87a5-c08cdbf94877 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:12.727659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-40218734-2718-419c-87a5-c08cdbf94877 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:12.735267 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-40218734-2718-419c-87a5-c08cdbf94877 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.322540 May 23 10:59:12.735962 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 406/798] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:12 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:13.752433 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1a0c593a-cea4-4ca0-9463-d4c05cd11124 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:13.752975 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1a0c593a-cea4-4ca0-9463-d4c05cd11124 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:13.759490 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1a0c593a-cea4-4ca0-9463-d4c05cd11124 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:13.759945 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1a0c593a-cea4-4ca0-9463-d4c05cd11124 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:13.760719 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1a0c593a-cea4-4ca0-9463-d4c05cd11124 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:13.761162 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1a0c593a-cea4-4ca0-9463-d4c05cd11124 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:13.891052 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1a0c593a-cea4-4ca0-9463-d4c05cd11124 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:13.900376 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1a0c593a-cea4-4ca0-9463-d4c05cd11124 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.151769 May 23 10:59:13.900961 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 393/799] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:13 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:14.244556 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-538cbd6b-fffc-449b-a8da-42de763e2223 req-71d1e477-253b-4870-b5ca-7fc0faa6dee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b27c20-a6cd-4dd3-9506-1d132be6e635", "name": "network-vif-plugged", "status": "completed", "tag": "28a6a33f-244e-40a2-b8a1-14db1a5fb3ba"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:59:14.253307 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-538cbd6b-fffc-449b-a8da-42de763e2223 req-71d1e477-253b-4870-b5ca-7fc0faa6dee6 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:14.253851 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-538cbd6b-fffc-449b-a8da-42de763e2223 req-71d1e477-253b-4870-b5ca-7fc0faa6dee6 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:14.266153 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-538cbd6b-fffc-449b-a8da-42de763e2223 req-71d1e477-253b-4870-b5ca-7fc0faa6dee6 service nova] Creating event network-vif-plugged:28a6a33f-244e-40a2-b8a1-14db1a5fb3ba for instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 on hv-cinder-83699 May 23 10:59:14.271809 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-538cbd6b-fffc-449b-a8da-42de763e2223 req-71d1e477-253b-4870-b5ca-7fc0faa6dee6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 May 23 10:59:14.272784 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 407/800] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:59:14.917888 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e9e90032-f861-4261-9e94-88c7e498a812 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:14.918467 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e9e90032-f861-4261-9e94-88c7e498a812 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:14.924922 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e9e90032-f861-4261-9e94-88c7e498a812 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:14.925465 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e9e90032-f861-4261-9e94-88c7e498a812 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:14.926404 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e9e90032-f861-4261-9e94-88c7e498a812 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:14.926953 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e9e90032-f861-4261-9e94-88c7e498a812 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:15.062958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e9e90032-f861-4261-9e94-88c7e498a812 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:15.070945 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e9e90032-f861-4261-9e94-88c7e498a812 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.157596 May 23 10:59:15.071510 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 394/801] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:14 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:16.090197 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-13c6c603-6e1f-4fcb-abb7-8f960eea61fe tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:16.090881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-13c6c603-6e1f-4fcb-abb7-8f960eea61fe tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:16.097031 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-13c6c603-6e1f-4fcb-abb7-8f960eea61fe tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:16.097472 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-13c6c603-6e1f-4fcb-abb7-8f960eea61fe tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:16.098265 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-13c6c603-6e1f-4fcb-abb7-8f960eea61fe tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:16.098699 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-13c6c603-6e1f-4fcb-abb7-8f960eea61fe tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:16.236989 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-13c6c603-6e1f-4fcb-abb7-8f960eea61fe tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:16.244902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-13c6c603-6e1f-4fcb-abb7-8f960eea61fe tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.160131 May 23 10:59:16.245141 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 408/802] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:16 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:17.260651 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0379b9fe-8bb0-44a2-8d3f-221cd7ab0248 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:17.261291 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0379b9fe-8bb0-44a2-8d3f-221cd7ab0248 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:17.267888 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0379b9fe-8bb0-44a2-8d3f-221cd7ab0248 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:17.268340 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0379b9fe-8bb0-44a2-8d3f-221cd7ab0248 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:17.269112 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0379b9fe-8bb0-44a2-8d3f-221cd7ab0248 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:17.269572 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0379b9fe-8bb0-44a2-8d3f-221cd7ab0248 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:17.412069 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0379b9fe-8bb0-44a2-8d3f-221cd7ab0248 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:17.420514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0379b9fe-8bb0-44a2-8d3f-221cd7ab0248 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1260 microversion: 2.1 time: 0.163564 May 23 10:59:17.421173 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 395/803] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:17 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:18.437883 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-aabcac9c-d682-47dd-993e-2d407662a12a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:18.438536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-aabcac9c-d682-47dd-993e-2d407662a12a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:18.445482 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aabcac9c-d682-47dd-993e-2d407662a12a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:18.445932 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aabcac9c-d682-47dd-993e-2d407662a12a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:18.446716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aabcac9c-d682-47dd-993e-2d407662a12a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:18.447157 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-aabcac9c-d682-47dd-993e-2d407662a12a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:18.582568 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-aabcac9c-d682-47dd-993e-2d407662a12a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:18.591536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-aabcac9c-d682-47dd-993e-2d407662a12a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1444 microversion: 2.1 time: 0.157322 May 23 10:59:18.592103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 409/804] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:18 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:18.608124 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-7eb19544-93a7-4632-9b19-8ff9fc1753bf tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:18.608741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-7eb19544-93a7-4632-9b19-8ff9fc1753bf tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:18.615103 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7eb19544-93a7-4632-9b19-8ff9fc1753bf tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:18.615740 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7eb19544-93a7-4632-9b19-8ff9fc1753bf tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:18.617023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7eb19544-93a7-4632-9b19-8ff9fc1753bf tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:18.617466 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-7eb19544-93a7-4632-9b19-8ff9fc1753bf tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:18.758015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-7eb19544-93a7-4632-9b19-8ff9fc1753bf tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:18.765553 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-7eb19544-93a7-4632-9b19-8ff9fc1753bf tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1444 microversion: 2.1 time: 0.161323 May 23 10:59:18.766152 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 396/805] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:18 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:20.691018 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-91d63db7-dc96-453a-8505-d7e7454887f1 req-aef2acca-b7a2-4e50-b294-af30937afbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b27c20-a6cd-4dd3-9506-1d132be6e635", "tag": "28a6a33f-244e-40a2-b8a1-14db1a5fb3ba"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:59:20.699141 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-91d63db7-dc96-453a-8505-d7e7454887f1 req-aef2acca-b7a2-4e50-b294-af30937afbb0 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:20.699534 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-91d63db7-dc96-453a-8505-d7e7454887f1 req-aef2acca-b7a2-4e50-b294-af30937afbb0 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:20.710249 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-91d63db7-dc96-453a-8505-d7e7454887f1 req-aef2acca-b7a2-4e50-b294-af30937afbb0 service nova] Creating event network-changed:28a6a33f-244e-40a2-b8a1-14db1a5fb3ba for instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 on hv-cinder-83699 May 23 10:59:20.715396 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-91d63db7-dc96-453a-8505-d7e7454887f1 req-aef2acca-b7a2-4e50-b294-af30937afbb0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152527 May 23 10:59:20.716014 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 410/806] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:59:39.262328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-894951165", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "networks": [{"uuid": "24e7ee2f-6cc6-4914-9693-0945f682dc1a"}]}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:59:39.275529 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=22 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:39.276505 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=54 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:39.331438 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.network.neutron [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] validate_networks() for [('24e7ee2f-6cc6-4914-9693-0945f682dc1a', None, None, None, None, None)] {{(pid=129030) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 10:59:39.698671 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Flavor limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 10:59:39.699421 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Image limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 10:59:39.699906 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Flavor pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 10:59:39.700336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Image pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 10:59:39.701029 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 10:59:39.711028 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:39.711772 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:39.712599 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:39.713045 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:39.733213 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Getting quotas for project 0c7e29a1e59b43a4a35f700a7e1be42c. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:59:39.737809 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Getting quotas for user dd2c5c03daed4679afee0143e6e99a68 and project 0c7e29a1e59b43a4a35f700a7e1be42c. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:59:39.751251 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Going to run 1 instances... {{(pid=129030) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 10:59:39.753824 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 10:59:39.806789 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-406c880b-329c-4b03-b68f-c1fd82068acd tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548391 May 23 10:59:39.807639 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 397/807] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 10:59:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 10:59:39.816184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:39.816980 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=50 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:39.838580 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a6ab5f6e-2eef-42ce-85c2-9dca0c87f121 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:39.843136 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a6ab5f6e-2eef-42ce-85c2-9dca0c87f121 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:39.985732 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a6ab5f6e-2eef-42ce-85c2-9dca0c87f121 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:39.997226 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a6ab5f6e-2eef-42ce-85c2-9dca0c87f121 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1218 microversion: 2.1 time: 0.182529 May 23 10:59:40.009798 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 411/808] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:39 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:59:41.019084 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-85dc2376-4d2b-4088-9bcc-c3ec266ad2db tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:41.021961 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-85dc2376-4d2b-4088-9bcc-c3ec266ad2db tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:41.048151 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-85dc2376-4d2b-4088-9bcc-c3ec266ad2db tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:41.051385 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-85dc2376-4d2b-4088-9bcc-c3ec266ad2db tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:41.054487 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-85dc2376-4d2b-4088-9bcc-c3ec266ad2db tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:41.054990 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-85dc2376-4d2b-4088-9bcc-c3ec266ad2db tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:41.256347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-85dc2376-4d2b-4088-9bcc-c3ec266ad2db tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:41.270393 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-85dc2376-4d2b-4088-9bcc-c3ec266ad2db tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1278 microversion: 2.1 time: 0.259006 May 23 10:59:41.272434 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 398/809] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:41 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 10:59:42.288797 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a091f4c7-9a5c-448b-8a96-4b7973dd575f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:42.289419 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a091f4c7-9a5c-448b-8a96-4b7973dd575f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:42.296785 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a091f4c7-9a5c-448b-8a96-4b7973dd575f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:42.297299 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a091f4c7-9a5c-448b-8a96-4b7973dd575f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:42.298540 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a091f4c7-9a5c-448b-8a96-4b7973dd575f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:42.299327 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a091f4c7-9a5c-448b-8a96-4b7973dd575f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:42.472024 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a091f4c7-9a5c-448b-8a96-4b7973dd575f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:42.481178 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a091f4c7-9a5c-448b-8a96-4b7973dd575f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1318 microversion: 2.1 time: 0.196134 May 23 10:59:42.482808 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 412/810] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:42 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:42.758414 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-dd8838e9-6037-45bb-af90-4aa48df0534f req-07d907b0-d0b1-4cfb-a448-5017b6c1877d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c61ca0-388f-4213-948f-04b0a2e06b56", "tag": "d8eccad9-0c5c-4965-b3fd-34dfbf8e7af6"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:59:42.788257 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-dd8838e9-6037-45bb-af90-4aa48df0534f req-07d907b0-d0b1-4cfb-a448-5017b6c1877d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:42.789053 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-dd8838e9-6037-45bb-af90-4aa48df0534f req-07d907b0-d0b1-4cfb-a448-5017b6c1877d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:42.806361 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-dd8838e9-6037-45bb-af90-4aa48df0534f req-07d907b0-d0b1-4cfb-a448-5017b6c1877d service nova] Creating event network-changed:d8eccad9-0c5c-4965-b3fd-34dfbf8e7af6 for instance 27c61ca0-388f-4213-948f-04b0a2e06b56 on hv-cinder-83699 May 23 10:59:42.815696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-dd8838e9-6037-45bb-af90-4aa48df0534f req-07d907b0-d0b1-4cfb-a448-5017b6c1877d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068648 May 23 10:59:42.816844 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 399/811] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:59:43.501170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1730e766-bf4c-4444-b02b-d894c4a043f0 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:43.502424 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1730e766-bf4c-4444-b02b-d894c4a043f0 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:43.511801 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1730e766-bf4c-4444-b02b-d894c4a043f0 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:43.512270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1730e766-bf4c-4444-b02b-d894c4a043f0 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:43.513163 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1730e766-bf4c-4444-b02b-d894c4a043f0 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:43.513856 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1730e766-bf4c-4444-b02b-d894c4a043f0 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:43.843923 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1730e766-bf4c-4444-b02b-d894c4a043f0 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:43.856291 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1730e766-bf4c-4444-b02b-d894c4a043f0 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1318 microversion: 2.1 time: 0.361088 May 23 10:59:43.857003 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 413/812] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:43 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:44.873165 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-136de00c-641a-4401-b614-f17e8e373992 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:44.874463 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-136de00c-641a-4401-b614-f17e8e373992 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:44.894612 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-136de00c-641a-4401-b614-f17e8e373992 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:44.895421 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-136de00c-641a-4401-b614-f17e8e373992 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:44.897718 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-136de00c-641a-4401-b614-f17e8e373992 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:44.899637 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-136de00c-641a-4401-b614-f17e8e373992 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:45.277699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-136de00c-641a-4401-b614-f17e8e373992 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:45.289642 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-136de00c-641a-4401-b614-f17e8e373992 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1318 microversion: 2.1 time: 0.420599 May 23 10:59:45.290258 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 400/813] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:44 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:46.307504 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f0cf8a8a-ec47-433d-b0d4-6363b210877a tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:46.308129 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f0cf8a8a-ec47-433d-b0d4-6363b210877a tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:46.319386 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f0cf8a8a-ec47-433d-b0d4-6363b210877a tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:46.319769 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f0cf8a8a-ec47-433d-b0d4-6363b210877a tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:46.320573 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f0cf8a8a-ec47-433d-b0d4-6363b210877a tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:46.325631 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f0cf8a8a-ec47-433d-b0d4-6363b210877a tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:46.735839 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f0cf8a8a-ec47-433d-b0d4-6363b210877a tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:46.759994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f0cf8a8a-ec47-433d-b0d4-6363b210877a tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1318 microversion: 2.1 time: 0.455304 May 23 10:59:46.774666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 414/814] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:46 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:47.781195 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0bcc1f00-b50f-454a-bb6b-0c80cf80ae58 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:47.782529 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0bcc1f00-b50f-454a-bb6b-0c80cf80ae58 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:47.790357 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0bcc1f00-b50f-454a-bb6b-0c80cf80ae58 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:47.791040 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0bcc1f00-b50f-454a-bb6b-0c80cf80ae58 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:47.791992 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0bcc1f00-b50f-454a-bb6b-0c80cf80ae58 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:47.792637 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0bcc1f00-b50f-454a-bb6b-0c80cf80ae58 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:47.989018 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0bcc1f00-b50f-454a-bb6b-0c80cf80ae58 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:47.997436 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0bcc1f00-b50f-454a-bb6b-0c80cf80ae58 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1318 microversion: 2.1 time: 0.221813 May 23 10:59:47.998682 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 401/815] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:47 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:48.284844 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f7e74c9f-0b6d-42f3-9b95-cc6b9e2fa489 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Action: 'create', calling method: .version_select at 0x7fe7200aa8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1840680101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaKa29BP/oLnGKSAchVm3wI8LC7/JemTSrSuPNnIuPOiKUoqYGCtzk/gAMDWDHhzh1XUFzvdMLFzNhlL/tJS5wn4LzsTgpQoR0BKKZdzkr4zJtiTulnj3HWZ5QIQb6vZA=="}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:59:48.301178 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-f7e74c9f-0b6d-42f3-9b95-cc6b9e2fa489 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Getting quotas for project 86e332b470c841db8d7d852c1c0a4a26. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 10:59:48.305423 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-f7e74c9f-0b6d-42f3-9b95-cc6b9e2fa489 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Getting quotas for user 5b53f05946e34f9f8395526212c5b17f and project 86e332b470c841db8d7d852c1c0a4a26. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 10:59:48.329385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f7e74c9f-0b6d-42f3-9b95-cc6b9e2fa489 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.226440 May 23 10:59:48.330106 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 415/816] 10.222.0.36 () {60 vars in 1158 bytes} [Mon May 23 10:59:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 10:59:48.848518 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-13895d8a-8443-4d1d-8043-4a73abd117ff req-182fbd36-1fea-4e0a-a29f-875e98ef3af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c61ca0-388f-4213-948f-04b0a2e06b56", "name": "network-vif-plugged", "status": "completed", "tag": "d8eccad9-0c5c-4965-b3fd-34dfbf8e7af6"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 10:59:48.867796 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-13895d8a-8443-4d1d-8043-4a73abd117ff req-182fbd36-1fea-4e0a-a29f-875e98ef3af7 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:48.868637 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-13895d8a-8443-4d1d-8043-4a73abd117ff req-182fbd36-1fea-4e0a-a29f-875e98ef3af7 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:48.892813 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-13895d8a-8443-4d1d-8043-4a73abd117ff req-182fbd36-1fea-4e0a-a29f-875e98ef3af7 service nova] Creating event network-vif-plugged:d8eccad9-0c5c-4965-b3fd-34dfbf8e7af6 for instance 27c61ca0-388f-4213-948f-04b0a2e06b56 on hv-cinder-83699 May 23 10:59:48.905664 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-13895d8a-8443-4d1d-8043-4a73abd117ff req-182fbd36-1fea-4e0a-a29f-875e98ef3af7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060388 May 23 10:59:48.906802 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 402/817] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 10:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 10:59:49.016558 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e2fd6beb-cc45-4c2d-b0c8-3d74d7a3f312 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:49.017235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e2fd6beb-cc45-4c2d-b0c8-3d74d7a3f312 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:49.034120 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e2fd6beb-cc45-4c2d-b0c8-3d74d7a3f312 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:49.036092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e2fd6beb-cc45-4c2d-b0c8-3d74d7a3f312 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:49.037245 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e2fd6beb-cc45-4c2d-b0c8-3d74d7a3f312 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:49.038404 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-e2fd6beb-cc45-4c2d-b0c8-3d74d7a3f312 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:49.317217 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e2fd6beb-cc45-4c2d-b0c8-3d74d7a3f312 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:49.326484 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e2fd6beb-cc45-4c2d-b0c8-3d74d7a3f312 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1318 microversion: 2.1 time: 0.315677 May 23 10:59:49.327675 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 416/818] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:49 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:50.339657 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:50.340450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=6 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 10:59:50.345458 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d5c261eb-934f-4799-a9de-8dd7425a9837 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:50.346214 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d5c261eb-934f-4799-a9de-8dd7425a9837 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:50.353282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d5c261eb-934f-4799-a9de-8dd7425a9837 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:50.353790 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d5c261eb-934f-4799-a9de-8dd7425a9837 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:50.354599 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d5c261eb-934f-4799-a9de-8dd7425a9837 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:50.355035 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d5c261eb-934f-4799-a9de-8dd7425a9837 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:50.499422 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d5c261eb-934f-4799-a9de-8dd7425a9837 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:50.507250 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d5c261eb-934f-4799-a9de-8dd7425a9837 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1318 microversion: 2.1 time: 0.168540 May 23 10:59:50.507828 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 403/819] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:50 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 10:59:51.524465 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-945c9fd5-66a0-4096-8dce-2da3a1b5e2a6 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 10:59:51.525045 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-945c9fd5-66a0-4096-8dce-2da3a1b5e2a6 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 10:59:51.531859 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-945c9fd5-66a0-4096-8dce-2da3a1b5e2a6 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:51.532300 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-945c9fd5-66a0-4096-8dce-2da3a1b5e2a6 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:51.533063 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-945c9fd5-66a0-4096-8dce-2da3a1b5e2a6 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 10:59:51.533498 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-945c9fd5-66a0-4096-8dce-2da3a1b5e2a6 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 10:59:51.673723 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-945c9fd5-66a0-4096-8dce-2da3a1b5e2a6 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 10:59:51.682391 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-945c9fd5-66a0-4096-8dce-2da3a1b5e2a6 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1507 microversion: 2.1 time: 0.161971 May 23 10:59:51.683067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 417/820] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 10:59:51 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 11:00:10.312394 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1296346551", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1840680101", "security_groups": [{"name": "tempest-secgroup-smoke-595907096"}], "block_device_mapping_v2": [{"uuid": "129b7f94-7863-4971-9448-501821935569", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b814bad-a4b2-460e-a94c-57193f7a8608"}]}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:00:10.320686 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:10.321452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=30 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:10.426944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.network.neutron [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] validate_networks() for [('3b814bad-a4b2-460e-a94c-57193f7a8608', None, None, None, None, None)] {{(pid=129030) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 11:00:10.785277 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Flavor limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 11:00:10.785706 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Image limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 11:00:10.786205 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Flavor pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 11:00:10.786618 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Image pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 11:00:10.787030 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 11:00:10.795998 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:10.796446 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:10.797275 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:10.797712 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:10.814708 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Getting quotas for project 86e332b470c841db8d7d852c1c0a4a26. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 11:00:10.818625 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Getting quotas for user 5b53f05946e34f9f8395526212c5b17f and project 86e332b470c841db8d7d852c1c0a4a26. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 11:00:10.876060 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Going to run 1 instances... {{(pid=129030) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 11:00:10.878199 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='129b7f94-7863-4971-9448-501821935569',volume_size=None,volume_type=None)] {{(pid=129030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 11:00:11.011335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a88b2727-a9f0-420a-b981-c6246fedda57 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.702966 May 23 11:00:11.011970 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 404/821] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 11:00:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 11:00:11.022708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f8bdb02c-950c-4496-8bff-f1ccc13413f1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:11.023314 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f8bdb02c-950c-4496-8bff-f1ccc13413f1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:11.025419 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=6 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:11.026285 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:11.026934 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=30 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:11.079953 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f8bdb02c-950c-4496-8bff-f1ccc13413f1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:11.087065 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f8bdb02c-950c-4496-8bff-f1ccc13413f1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1095 microversion: 2.1 time: 0.068326 May 23 11:00:11.087573 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 418/822] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:11 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:12.104976 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-69854b27-f8ae-47c2-995c-5b504fff1a48 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:12.105588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-69854b27-f8ae-47c2-995c-5b504fff1a48 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:12.112127 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-69854b27-f8ae-47c2-995c-5b504fff1a48 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:12.112572 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-69854b27-f8ae-47c2-995c-5b504fff1a48 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:12.113328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-69854b27-f8ae-47c2-995c-5b504fff1a48 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:12.113757 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-69854b27-f8ae-47c2-995c-5b504fff1a48 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:12.176548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-69854b27-f8ae-47c2-995c-5b504fff1a48 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:12.184178 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-69854b27-f8ae-47c2-995c-5b504fff1a48 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1193 microversion: 2.1 time: 0.083549 May 23 11:00:12.184792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 405/823] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:12 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:13.200789 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a494903e-3384-4430-983e-2b280ebafb4d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:13.201762 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a494903e-3384-4430-983e-2b280ebafb4d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:13.210396 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a494903e-3384-4430-983e-2b280ebafb4d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:13.211073 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a494903e-3384-4430-983e-2b280ebafb4d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:13.212184 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a494903e-3384-4430-983e-2b280ebafb4d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:13.212953 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a494903e-3384-4430-983e-2b280ebafb4d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:13.280600 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-17375621-c43e-4cf2-9689-f803d28721b2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3db7da3-9aa5-4f30-ba20-52b2433e45f7", "device": "/dev/sdb"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:00:13.282342 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-17375621-c43e-4cf2-9689-f803d28721b2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:13.288839 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-17375621-c43e-4cf2-9689-f803d28721b2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:13.289286 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-17375621-c43e-4cf2-9689-f803d28721b2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:13.290082 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-17375621-c43e-4cf2-9689-f803d28721b2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:13.290519 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-17375621-c43e-4cf2-9689-f803d28721b2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:13.375480 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a494903e-3384-4430-983e-2b280ebafb4d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:13.383302 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a494903e-3384-4430-983e-2b280ebafb4d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.186549 May 23 11:00:13.384204 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 419/824] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:13 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 11:00:13.574795 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-17375621-c43e-4cf2-9689-f803d28721b2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "POST /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297981 May 23 11:00:13.580763 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 406/825] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 11:00:13 2022] POST /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:00:13.745252 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-2e81b3c8-67ab-4574-9d65-f71c45c3661a req-be7e8880-4ec4-48b9-bd4d-d4ffeaf2fc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5249a457-7b0f-4659-8591-228ab1ea821e", "tag": "176ef9af-c6c7-4d03-80eb-ba6a7ce97f4c"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:00:13.770143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-2e81b3c8-67ab-4574-9d65-f71c45c3661a req-be7e8880-4ec4-48b9-bd4d-d4ffeaf2fc70 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:13.770602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-2e81b3c8-67ab-4574-9d65-f71c45c3661a req-be7e8880-4ec4-48b9-bd4d-d4ffeaf2fc70 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:13.783075 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-2e81b3c8-67ab-4574-9d65-f71c45c3661a req-be7e8880-4ec4-48b9-bd4d-d4ffeaf2fc70 service nova] Creating event network-changed:176ef9af-c6c7-4d03-80eb-ba6a7ce97f4c for instance 5249a457-7b0f-4659-8591-228ab1ea821e on hv-cinder-83699 May 23 11:00:13.789014 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-2e81b3c8-67ab-4574-9d65-f71c45c3661a req-be7e8880-4ec4-48b9-bd4d-d4ffeaf2fc70 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048067 May 23 11:00:13.789618 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 420/826] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 11:00:14.401817 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-40e6cc4d-0a7d-46c8-9fce-e134b49e64ae tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:14.402576 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-40e6cc4d-0a7d-46c8-9fce-e134b49e64ae tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:14.409391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-40e6cc4d-0a7d-46c8-9fce-e134b49e64ae tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:14.409841 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-40e6cc4d-0a7d-46c8-9fce-e134b49e64ae tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:14.410642 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-40e6cc4d-0a7d-46c8-9fce-e134b49e64ae tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:14.411083 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-40e6cc4d-0a7d-46c8-9fce-e134b49e64ae tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:14.552313 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-40e6cc4d-0a7d-46c8-9fce-e134b49e64ae tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:14.559915 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-40e6cc4d-0a7d-46c8-9fce-e134b49e64ae tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.162707 May 23 11:00:14.560441 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 407/827] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:14 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:15.577663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a440615c-d92c-4f48-bf63-4df49215f43e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:15.578384 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a440615c-d92c-4f48-bf63-4df49215f43e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:15.584616 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a440615c-d92c-4f48-bf63-4df49215f43e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:15.585070 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a440615c-d92c-4f48-bf63-4df49215f43e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:15.585826 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a440615c-d92c-4f48-bf63-4df49215f43e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:15.586302 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a440615c-d92c-4f48-bf63-4df49215f43e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:15.714018 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a440615c-d92c-4f48-bf63-4df49215f43e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:15.721834 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a440615c-d92c-4f48-bf63-4df49215f43e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.149126 May 23 11:00:15.722423 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 421/828] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:15 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:16.738978 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0a078270-be7a-4aee-ad61-75b2abd6c1bc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:16.739594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0a078270-be7a-4aee-ad61-75b2abd6c1bc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:16.746152 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0a078270-be7a-4aee-ad61-75b2abd6c1bc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:16.746603 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0a078270-be7a-4aee-ad61-75b2abd6c1bc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:16.747369 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0a078270-be7a-4aee-ad61-75b2abd6c1bc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:16.747804 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0a078270-be7a-4aee-ad61-75b2abd6c1bc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:16.882373 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0a078270-be7a-4aee-ad61-75b2abd6c1bc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:16.889778 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0a078270-be7a-4aee-ad61-75b2abd6c1bc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.154651 May 23 11:00:16.890355 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 408/829] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:16 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:17.906570 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4bd09cc1-2649-4f51-bf30-fdbe3f4c0013 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:17.907183 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-4bd09cc1-2649-4f51-bf30-fdbe3f4c0013 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:17.913700 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4bd09cc1-2649-4f51-bf30-fdbe3f4c0013 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:17.914189 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4bd09cc1-2649-4f51-bf30-fdbe3f4c0013 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:17.914956 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4bd09cc1-2649-4f51-bf30-fdbe3f4c0013 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:17.915393 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4bd09cc1-2649-4f51-bf30-fdbe3f4c0013 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:18.045348 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-4bd09cc1-2649-4f51-bf30-fdbe3f4c0013 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:18.053217 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4bd09cc1-2649-4f51-bf30-fdbe3f4c0013 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.150481 May 23 11:00:18.053778 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 422/830] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:17 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:19.070053 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ebb1b0c1-15ad-49af-91e0-117efbb05eab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:19.070678 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ebb1b0c1-15ad-49af-91e0-117efbb05eab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:19.077436 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ebb1b0c1-15ad-49af-91e0-117efbb05eab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:19.077877 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ebb1b0c1-15ad-49af-91e0-117efbb05eab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:19.078685 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ebb1b0c1-15ad-49af-91e0-117efbb05eab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:19.079127 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ebb1b0c1-15ad-49af-91e0-117efbb05eab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:19.208949 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ebb1b0c1-15ad-49af-91e0-117efbb05eab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:19.216455 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ebb1b0c1-15ad-49af-91e0-117efbb05eab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.150256 May 23 11:00:19.217048 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 409/831] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:19 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:20.234267 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-41dd6ccd-d043-4865-950a-3a6117df7458 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:20.234867 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-41dd6ccd-d043-4865-950a-3a6117df7458 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:20.241476 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-41dd6ccd-d043-4865-950a-3a6117df7458 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:20.241863 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-41dd6ccd-d043-4865-950a-3a6117df7458 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:20.242663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-41dd6ccd-d043-4865-950a-3a6117df7458 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:20.243092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-41dd6ccd-d043-4865-950a-3a6117df7458 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:20.371533 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-41dd6ccd-d043-4865-950a-3a6117df7458 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:20.379441 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-41dd6ccd-d043-4865-950a-3a6117df7458 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.149635 May 23 11:00:20.380005 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 423/832] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:20 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:21.396490 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-dc007e94-5a45-42e4-be0c-89ce9530822d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:21.397047 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-dc007e94-5a45-42e4-be0c-89ce9530822d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:21.399494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:21.400159 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=6 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:21.406862 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dc007e94-5a45-42e4-be0c-89ce9530822d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:21.407315 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dc007e94-5a45-42e4-be0c-89ce9530822d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:21.408092 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dc007e94-5a45-42e4-be0c-89ce9530822d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:21.408534 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dc007e94-5a45-42e4-be0c-89ce9530822d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:21.538020 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-dc007e94-5a45-42e4-be0c-89ce9530822d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:21.545342 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-dc007e94-5a45-42e4-be0c-89ce9530822d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.153064 May 23 11:00:21.546557 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 410/833] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:21 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:22.563146 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d799623e-1c72-476a-9fb9-0811584c2334 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:22.563741 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d799623e-1c72-476a-9fb9-0811584c2334 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:22.565763 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:22.571813 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d799623e-1c72-476a-9fb9-0811584c2334 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:22.572257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d799623e-1c72-476a-9fb9-0811584c2334 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:22.573012 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d799623e-1c72-476a-9fb9-0811584c2334 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:22.573441 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d799623e-1c72-476a-9fb9-0811584c2334 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:22.699803 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d799623e-1c72-476a-9fb9-0811584c2334 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:22.707236 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d799623e-1c72-476a-9fb9-0811584c2334 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.148612 May 23 11:00:22.707791 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 424/834] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:22 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:23.724023 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9ecb6bac-1503-447f-a613-1be8fb17eb5a tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:23.724633 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9ecb6bac-1503-447f-a613-1be8fb17eb5a tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:23.731182 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9ecb6bac-1503-447f-a613-1be8fb17eb5a tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:23.731623 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9ecb6bac-1503-447f-a613-1be8fb17eb5a tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:23.732378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9ecb6bac-1503-447f-a613-1be8fb17eb5a tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:23.732808 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9ecb6bac-1503-447f-a613-1be8fb17eb5a tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:23.860070 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-9ecb6bac-1503-447f-a613-1be8fb17eb5a tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:23.867390 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9ecb6bac-1503-447f-a613-1be8fb17eb5a tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.147248 May 23 11:00:23.867951 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 411/835] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:23 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:24.884441 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-047f69d3-f68c-4f7f-be27-79c04ec69ee1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:24.885049 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-047f69d3-f68c-4f7f-be27-79c04ec69ee1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:24.892084 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-047f69d3-f68c-4f7f-be27-79c04ec69ee1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:24.892533 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-047f69d3-f68c-4f7f-be27-79c04ec69ee1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:24.893417 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-047f69d3-f68c-4f7f-be27-79c04ec69ee1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:24.893719 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-047f69d3-f68c-4f7f-be27-79c04ec69ee1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:25.024937 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-047f69d3-f68c-4f7f-be27-79c04ec69ee1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:25.033093 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-047f69d3-f68c-4f7f-be27-79c04ec69ee1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.152527 May 23 11:00:25.033660 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 425/836] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:24 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:26.050954 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4d1ae388-9c65-4892-a424-48d966c32ce0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:26.051566 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4d1ae388-9c65-4892-a424-48d966c32ce0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:26.058036 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4d1ae388-9c65-4892-a424-48d966c32ce0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:26.058484 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4d1ae388-9c65-4892-a424-48d966c32ce0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:26.059248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4d1ae388-9c65-4892-a424-48d966c32ce0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:26.059681 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4d1ae388-9c65-4892-a424-48d966c32ce0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:26.190844 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4d1ae388-9c65-4892-a424-48d966c32ce0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:26.198292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4d1ae388-9c65-4892-a424-48d966c32ce0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.151198 May 23 11:00:26.198857 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 412/837] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:26 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:27.214880 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a8efb124-a869-486c-ac8c-d24dac2444aa tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:27.215496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a8efb124-a869-486c-ac8c-d24dac2444aa tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:27.222589 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8efb124-a869-486c-ac8c-d24dac2444aa tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:27.223037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8efb124-a869-486c-ac8c-d24dac2444aa tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:27.223832 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8efb124-a869-486c-ac8c-d24dac2444aa tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:27.224270 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a8efb124-a869-486c-ac8c-d24dac2444aa tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:27.351126 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a8efb124-a869-486c-ac8c-d24dac2444aa tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:27.358533 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a8efb124-a869-486c-ac8c-d24dac2444aa tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.147479 May 23 11:00:27.359086 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 426/838] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:27 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:28.374663 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-bc0400b9-2c5c-451a-9b19-8753cfc1f5df tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:28.375299 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-bc0400b9-2c5c-451a-9b19-8753cfc1f5df tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:28.381771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bc0400b9-2c5c-451a-9b19-8753cfc1f5df tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:28.382254 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bc0400b9-2c5c-451a-9b19-8753cfc1f5df tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:28.383008 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bc0400b9-2c5c-451a-9b19-8753cfc1f5df tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:28.383439 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-bc0400b9-2c5c-451a-9b19-8753cfc1f5df tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:28.510351 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-bc0400b9-2c5c-451a-9b19-8753cfc1f5df tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:28.517857 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-bc0400b9-2c5c-451a-9b19-8753cfc1f5df tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.147581 May 23 11:00:28.518469 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 413/839] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:28 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:28.782033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-fdc4a06d-379c-425d-bd4a-0184046951a4 req-fe1b7167-55e4-4dd2-ad67-10ee4270e0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5249a457-7b0f-4659-8591-228ab1ea821e", "name": "network-vif-plugged", "status": "completed", "tag": "176ef9af-c6c7-4d03-80eb-ba6a7ce97f4c"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:00:28.790386 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-fdc4a06d-379c-425d-bd4a-0184046951a4 req-fe1b7167-55e4-4dd2-ad67-10ee4270e0ba service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:28.790826 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-fdc4a06d-379c-425d-bd4a-0184046951a4 req-fe1b7167-55e4-4dd2-ad67-10ee4270e0ba service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:28.802307 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-fdc4a06d-379c-425d-bd4a-0184046951a4 req-fe1b7167-55e4-4dd2-ad67-10ee4270e0ba service nova] Creating event network-vif-plugged:176ef9af-c6c7-4d03-80eb-ba6a7ce97f4c for instance 5249a457-7b0f-4659-8591-228ab1ea821e on hv-cinder-83699 May 23 11:00:28.807143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-fdc4a06d-379c-425d-bd4a-0184046951a4 req-fe1b7167-55e4-4dd2-ad67-10ee4270e0ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028863 May 23 11:00:28.807725 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 427/840] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:00:29.535366 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-322f9d2b-a631-4bed-a7a2-0275a361fc54 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:29.535909 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-322f9d2b-a631-4bed-a7a2-0275a361fc54 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:29.542387 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-322f9d2b-a631-4bed-a7a2-0275a361fc54 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:29.542848 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-322f9d2b-a631-4bed-a7a2-0275a361fc54 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:29.543615 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-322f9d2b-a631-4bed-a7a2-0275a361fc54 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:29.544051 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-322f9d2b-a631-4bed-a7a2-0275a361fc54 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:29.671560 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-322f9d2b-a631-4bed-a7a2-0275a361fc54 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:29.679008 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-322f9d2b-a631-4bed-a7a2-0275a361fc54 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.147597 May 23 11:00:29.679588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 414/841] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:29 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:30.697124 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bd0953f4-5735-4b74-9019-bb6102df8044 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:30.697942 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bd0953f4-5735-4b74-9019-bb6102df8044 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:30.704317 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bd0953f4-5735-4b74-9019-bb6102df8044 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:30.704767 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bd0953f4-5735-4b74-9019-bb6102df8044 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:30.705537 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bd0953f4-5735-4b74-9019-bb6102df8044 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:30.706004 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bd0953f4-5735-4b74-9019-bb6102df8044 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:30.839844 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bd0953f4-5735-4b74-9019-bb6102df8044 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:30.847919 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bd0953f4-5735-4b74-9019-bb6102df8044 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1266 microversion: 2.1 time: 0.155529 May 23 11:00:30.848482 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 428/842] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:30 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:31.864549 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5149178f-7edd-4a5a-a1b8-dcf754e5e072 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:31.865119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5149178f-7edd-4a5a-a1b8-dcf754e5e072 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:31.871678 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5149178f-7edd-4a5a-a1b8-dcf754e5e072 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:31.872123 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5149178f-7edd-4a5a-a1b8-dcf754e5e072 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:31.872931 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5149178f-7edd-4a5a-a1b8-dcf754e5e072 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:31.873875 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5149178f-7edd-4a5a-a1b8-dcf754e5e072 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:32.001923 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5149178f-7edd-4a5a-a1b8-dcf754e5e072 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:32.009323 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5149178f-7edd-4a5a-a1b8-dcf754e5e072 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1454 microversion: 2.1 time: 0.148679 May 23 11:00:32.009885 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 415/843] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:31 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:32.026031 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-463b90e6-e263-4c6e-af4b-63337afe1e2b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:32.026640 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-463b90e6-e263-4c6e-af4b-63337afe1e2b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:32.032645 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-463b90e6-e263-4c6e-af4b-63337afe1e2b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:32.033088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-463b90e6-e263-4c6e-af4b-63337afe1e2b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:32.033840 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-463b90e6-e263-4c6e-af4b-63337afe1e2b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:32.034304 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-463b90e6-e263-4c6e-af4b-63337afe1e2b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:32.165505 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-463b90e6-e263-4c6e-af4b-63337afe1e2b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:32.172997 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-463b90e6-e263-4c6e-af4b-63337afe1e2b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1454 microversion: 2.1 time: 0.150838 May 23 11:00:32.173553 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 429/844] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:32 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:34.140818 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-0cbf5f5c-69d3-474f-a98c-970c6c4649bb req-8097d406-02c0-4379-a124-8f502bd834a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5249a457-7b0f-4659-8591-228ab1ea821e", "tag": "176ef9af-c6c7-4d03-80eb-ba6a7ce97f4c"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:00:34.150366 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-0cbf5f5c-69d3-474f-a98c-970c6c4649bb req-8097d406-02c0-4379-a124-8f502bd834a9 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:34.150816 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-0cbf5f5c-69d3-474f-a98c-970c6c4649bb req-8097d406-02c0-4379-a124-8f502bd834a9 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:34.162473 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-0cbf5f5c-69d3-474f-a98c-970c6c4649bb req-8097d406-02c0-4379-a124-8f502bd834a9 service nova] Creating event network-changed:176ef9af-c6c7-4d03-80eb-ba6a7ce97f4c for instance 5249a457-7b0f-4659-8591-228ab1ea821e on hv-cinder-83699 May 23 11:00:34.167547 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-0cbf5f5c-69d3-474f-a98c-970c6c4649bb req-8097d406-02c0-4379-a124-8f502bd834a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030557 May 23 11:00:34.168167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 416/845] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:00:38.320966 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-22bb05ed-e1b7-4b9d-bd9c-36d601fe56a2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:38.321448 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-22bb05ed-e1b7-4b9d-bd9c-36d601fe56a2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:38.328038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-22bb05ed-e1b7-4b9d-bd9c-36d601fe56a2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:38.328481 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-22bb05ed-e1b7-4b9d-bd9c-36d601fe56a2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:38.329235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-22bb05ed-e1b7-4b9d-bd9c-36d601fe56a2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:38.329665 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-22bb05ed-e1b7-4b9d-bd9c-36d601fe56a2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:38.411392 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-22bb05ed-e1b7-4b9d-bd9c-36d601fe56a2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lazy-loading 'services' on Instance uuid 27c61ca0-388f-4213-948f-04b0a2e06b56 {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 11:00:38.481232 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-22bb05ed-e1b7-4b9d-bd9c-36d601fe56a2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "DELETE /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56/os-volume_attachments/e3db7da3-9aa5-4f30-ba20-52b2433e45f7" status: 202 len: 0 microversion: 2.1 time: 0.164002 May 23 11:00:38.481862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 430/846] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 11:00:38 2022] DELETE /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56/os-volume_attachments/e3db7da3-9aa5-4f30-ba20-52b2433e45f7 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:00:39.593218 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-55b6a104-5057-46ab-be49-c02afa6dcb1e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:39.593802 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-55b6a104-5057-46ab-be49-c02afa6dcb1e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:39.600123 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-55b6a104-5057-46ab-be49-c02afa6dcb1e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:39.600568 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-55b6a104-5057-46ab-be49-c02afa6dcb1e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:39.601327 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-55b6a104-5057-46ab-be49-c02afa6dcb1e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:39.601762 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-55b6a104-5057-46ab-be49-c02afa6dcb1e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:39.629687 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-55b6a104-5057-46ab-be49-c02afa6dcb1e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Going to try to terminate instance {{(pid=129030) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 11:00:39.704043 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-55b6a104-5057-46ab-be49-c02afa6dcb1e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "DELETE /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 204 len: 0 microversion: 2.1 time: 0.115771 May 23 11:00:39.704950 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 417/847] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 11:00:39 2022] DELETE /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 11:00:39.714107 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f6021e16-0daf-4074-9b80-6039bbf55b4f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:39.714812 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f6021e16-0daf-4074-9b80-6039bbf55b4f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:39.721478 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f6021e16-0daf-4074-9b80-6039bbf55b4f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:39.721927 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f6021e16-0daf-4074-9b80-6039bbf55b4f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:39.722728 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f6021e16-0daf-4074-9b80-6039bbf55b4f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:39.723165 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f6021e16-0daf-4074-9b80-6039bbf55b4f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:39.851337 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f6021e16-0daf-4074-9b80-6039bbf55b4f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:39.859069 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f6021e16-0daf-4074-9b80-6039bbf55b4f tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1513 microversion: 2.1 time: 0.149861 May 23 11:00:39.859636 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 431/848] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:39 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:40.876290 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2a43c2c8-a582-455f-bb1b-ffaa5926b9ab tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:40.876997 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2a43c2c8-a582-455f-bb1b-ffaa5926b9ab tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:40.879365 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:40.884665 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2a43c2c8-a582-455f-bb1b-ffaa5926b9ab tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:40.885113 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2a43c2c8-a582-455f-bb1b-ffaa5926b9ab tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:40.885875 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2a43c2c8-a582-455f-bb1b-ffaa5926b9ab tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:40.886337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2a43c2c8-a582-455f-bb1b-ffaa5926b9ab tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:40.891650 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:41.017298 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2a43c2c8-a582-455f-bb1b-ffaa5926b9ab tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:41.025034 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2a43c2c8-a582-455f-bb1b-ffaa5926b9ab tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1513 microversion: 2.1 time: 0.153528 May 23 11:00:41.025598 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 418/849] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:40 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:42.016766 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-4f46e922-5a13-4e50-bd2b-a6ec2129dfe5 req-4b4308c6-53ff-4a36-b11d-038c9d8f5034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c61ca0-388f-4213-948f-04b0a2e06b56", "name": "network-vif-deleted", "tag": "d8eccad9-0c5c-4965-b3fd-34dfbf8e7af6"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:00:42.020820 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=31 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:42.027100 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-4f46e922-5a13-4e50-bd2b-a6ec2129dfe5 req-4b4308c6-53ff-4a36-b11d-038c9d8f5034 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:42.027544 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-4f46e922-5a13-4e50-bd2b-a6ec2129dfe5 req-4b4308c6-53ff-4a36-b11d-038c9d8f5034 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:42.032392 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:42.042685 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-83b830ce-6183-4384-8e55-ccb549295141 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:42.043406 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-83b830ce-6183-4384-8e55-ccb549295141 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:42.046945 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-4f46e922-5a13-4e50-bd2b-a6ec2129dfe5 req-4b4308c6-53ff-4a36-b11d-038c9d8f5034 service nova] Creating event network-vif-deleted:d8eccad9-0c5c-4965-b3fd-34dfbf8e7af6 for instance 27c61ca0-388f-4213-948f-04b0a2e06b56 on hv-cinder-83699 May 23 11:00:42.052512 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-4f46e922-5a13-4e50-bd2b-a6ec2129dfe5 req-4b4308c6-53ff-4a36-b11d-038c9d8f5034 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039810 May 23 11:00:42.053167 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 432/850] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:00:42.053457 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-83b830ce-6183-4384-8e55-ccb549295141 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:42.054718 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-83b830ce-6183-4384-8e55-ccb549295141 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:42.055494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-83b830ce-6183-4384-8e55-ccb549295141 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:42.055927 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-83b830ce-6183-4384-8e55-ccb549295141 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:42.117493 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-83b830ce-6183-4384-8e55-ccb549295141 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:42.125759 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-83b830ce-6183-4384-8e55-ccb549295141 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 200 len: 1303 microversion: 2.1 time: 0.087492 May 23 11:00:42.126484 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 419/851] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:42 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 11:00:43.143703 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5d0acc62-e65c-4e6d-b033-f1f7f062202c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:43.144401 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5d0acc62-e65c-4e6d-b033-f1f7f062202c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: 27c61ca0-388f-4213-948f-04b0a2e06b56] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:43.150912 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d0acc62-e65c-4e6d-b033-f1f7f062202c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:43.151312 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d0acc62-e65c-4e6d-b033-f1f7f062202c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:43.152080 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d0acc62-e65c-4e6d-b033-f1f7f062202c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:43.152522 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d0acc62-e65c-4e6d-b033-f1f7f062202c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:43.166017 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-5d0acc62-e65c-4e6d-b033-f1f7f062202c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] HTTP exception thrown: Instance 27c61ca0-388f-4213-948f-04b0a2e06b56 could not be found. May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5d0acc62-e65c-4e6d-b033-f1f7f062202c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Request method failure captured: May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 HTTP/1.1 May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2kZ_tgLUUkHraTkppiotJRbp4qKhD3DyulpvHiFDoJA7pIsCU-WDxqJs4TONfX4XXvtUrjnTSLbFOeoxSSAJKdkqUEfgmdnAFAB7ZAdBJtjnMNJvQuwdu9woUdpgpo9QNWXlErBM84aC1oO7djx4_tw2DJJL12sCV7X6qsYcVGDOL0 May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 0c7e29a1e59b43a4a35f700a7e1be42c May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesSnapshotTestJSON-979774303 May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 11:00:43.167624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c7e29a1e59b43a4a35f700a7e1be42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c7e29a1e59b43a4a35f700a7e1be42c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c7e29a1e59b43a4a35f700a7e1be42c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c7e29a1e59b43a4a35f700a7e1be42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesSnapshotTestJSON-979774303 May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 0c7e29a1e59b43a4a35f700a7e1be42c May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-979774303 May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesSnapshotTestJSON-979774303-project May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: dd2c5c03daed4679afee0143e6e99a68 May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesSnapshotTestJSON-979774303-project May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 27c61ca0-388f-4213-948f-04b0a2e06b56 could not be found. May 23 11:00:43.169276 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '27c61ca0-388f-4213-948f-04b0a2e06b56'} May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c61ca0-388f-4213-948f-04b0a2e06b56 could not be found. May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 11:00:43.170443 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c61ca0-388f-4213-948f-04b0a2e06b56 could not be found. May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c61ca0-388f-4213-948f-04b0a2e06b56 could not be found. May 23 11:00:43.172577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:00:43.173893 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5d0acc62-e65c-4e6d-b033-f1f7f062202c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Returning 404 to user: Instance 27c61ca0-388f-4213-948f-04b0a2e06b56 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 11:00:43.173893 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5d0acc62-e65c-4e6d-b033-f1f7f062202c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56" status: 404 len: 111 microversion: 2.1 time: 0.030073 May 23 11:00:43.173893 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 433/852] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:43 2022] GET /compute/v2.1/servers/27c61ca0-388f-4213-948f-04b0a2e06b56 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 11:00:50.948092 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1402499516", "imageRef": "a80bbe7c-5946-4d34-9db5-a98e43daff0a", "flavorRef": "452", "networks": [{"uuid": "24e7ee2f-6cc6-4914-9693-0945f682dc1a"}]}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:00:50.997569 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.network.neutron [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] validate_networks() for [('24e7ee2f-6cc6-4914-9693-0945f682dc1a', None, None, None, None, None)] {{(pid=129030) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 11:00:51.331426 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Flavor limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 11:00:51.331855 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Image limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 11:00:51.332338 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Flavor pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 11:00:51.332755 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Image pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 11:00:51.333172 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 11:00:51.342661 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:51.343718 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:51.344526 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:51.344962 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:51.361242 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Getting quotas for project 0c7e29a1e59b43a4a35f700a7e1be42c. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 11:00:51.365130 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Getting quotas for user dd2c5c03daed4679afee0143e6e99a68 and project 0c7e29a1e59b43a4a35f700a7e1be42c. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 11:00:51.376473 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Going to run 1 instances... {{(pid=129030) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 11:00:51.378737 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a80bbe7c-5946-4d34-9db5-a98e43daff0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 11:00:51.423738 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-dd3025ba-9821-4f47-a005-0abc130eb570 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.479433 May 23 11:00:51.424389 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 420/853] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 11:00:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 11:00:51.434388 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-e7522d81-9ad9-475b-9662-88e22dc61f21 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:51.434990 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-e7522d81-9ad9-475b-9662-88e22dc61f21 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:51.492376 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-e7522d81-9ad9-475b-9662-88e22dc61f21 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:51.499423 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-e7522d81-9ad9-475b-9662-88e22dc61f21 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1219 microversion: 2.1 time: 0.068574 May 23 11:00:51.500186 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 434/854] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:51 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 11:00:52.517293 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e68c5a85-417f-479e-9232-56f4ddd9e0cf tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:52.517852 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e68c5a85-417f-479e-9232-56f4ddd9e0cf tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:52.524554 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e68c5a85-417f-479e-9232-56f4ddd9e0cf tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:52.525012 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e68c5a85-417f-479e-9232-56f4ddd9e0cf tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:52.525786 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e68c5a85-417f-479e-9232-56f4ddd9e0cf tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:52.526253 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e68c5a85-417f-479e-9232-56f4ddd9e0cf tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:52.602233 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-e68c5a85-417f-479e-9232-56f4ddd9e0cf tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:52.610221 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e68c5a85-417f-479e-9232-56f4ddd9e0cf tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1289 microversion: 2.1 time: 0.097688 May 23 11:00:52.619832 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 421/855] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:52 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:53.628323 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-59f3263f-00c5-4371-a0ec-c49354792fad tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:53.628984 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-59f3263f-00c5-4371-a0ec-c49354792fad tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:53.632140 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=3 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:00:53.637713 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59f3263f-00c5-4371-a0ec-c49354792fad tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:53.638205 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59f3263f-00c5-4371-a0ec-c49354792fad tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:53.638994 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59f3263f-00c5-4371-a0ec-c49354792fad tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:53.639440 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59f3263f-00c5-4371-a0ec-c49354792fad tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:53.769075 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-59f3263f-00c5-4371-a0ec-c49354792fad tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:53.777255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-59f3263f-00c5-4371-a0ec-c49354792fad tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1319 microversion: 2.1 time: 0.153250 May 23 11:00:53.777900 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 435/856] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:53 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:53.784274 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-1dad75b1-8016-4503-b86b-4d438886aac7 req-257b356c-2768-48fd-822e-58a26806a0da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce77c74d-3e91-4fa5-a975-9f29723b1331", "tag": "1a66911b-a3d3-4782-b4f7-6527cbbddbb3"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:00:53.794212 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-1dad75b1-8016-4503-b86b-4d438886aac7 req-257b356c-2768-48fd-822e-58a26806a0da service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:53.794727 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-1dad75b1-8016-4503-b86b-4d438886aac7 req-257b356c-2768-48fd-822e-58a26806a0da service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:53.806599 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-1dad75b1-8016-4503-b86b-4d438886aac7 req-257b356c-2768-48fd-822e-58a26806a0da service nova] Creating event network-changed:1a66911b-a3d3-4782-b4f7-6527cbbddbb3 for instance ce77c74d-3e91-4fa5-a975-9f29723b1331 on hv-cinder-83699 May 23 11:00:53.811914 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-1dad75b1-8016-4503-b86b-4d438886aac7 req-257b356c-2768-48fd-822e-58a26806a0da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030849 May 23 11:00:53.812603 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 422/857] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:00:54.794290 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f67d71c3-8714-400e-a10a-40a0bd6a2445 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:54.794890 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f67d71c3-8714-400e-a10a-40a0bd6a2445 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:54.801314 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f67d71c3-8714-400e-a10a-40a0bd6a2445 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:54.801785 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f67d71c3-8714-400e-a10a-40a0bd6a2445 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:54.802587 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f67d71c3-8714-400e-a10a-40a0bd6a2445 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:54.803050 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f67d71c3-8714-400e-a10a-40a0bd6a2445 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:54.928522 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f67d71c3-8714-400e-a10a-40a0bd6a2445 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:54.935863 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f67d71c3-8714-400e-a10a-40a0bd6a2445 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1319 microversion: 2.1 time: 0.145365 May 23 11:00:54.936496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 436/858] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:54 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:55.952690 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-62b72bf7-7283-415b-9e17-205dae8ad683 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:55.953395 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-62b72bf7-7283-415b-9e17-205dae8ad683 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:55.960003 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-62b72bf7-7283-415b-9e17-205dae8ad683 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:55.960458 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-62b72bf7-7283-415b-9e17-205dae8ad683 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:55.961228 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-62b72bf7-7283-415b-9e17-205dae8ad683 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:55.961670 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-62b72bf7-7283-415b-9e17-205dae8ad683 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:56.333667 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-62b72bf7-7283-415b-9e17-205dae8ad683 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:56.341227 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-62b72bf7-7283-415b-9e17-205dae8ad683 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1319 microversion: 2.1 time: 0.393220 May 23 11:00:56.341765 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 423/859] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:55 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:57.358610 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a598bcc2-bde0-4a65-955e-f848399679c8 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:57.359214 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a598bcc2-bde0-4a65-955e-f848399679c8 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:57.365618 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a598bcc2-bde0-4a65-955e-f848399679c8 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:57.366095 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a598bcc2-bde0-4a65-955e-f848399679c8 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:57.366854 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a598bcc2-bde0-4a65-955e-f848399679c8 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:57.367287 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a598bcc2-bde0-4a65-955e-f848399679c8 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:57.495506 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a598bcc2-bde0-4a65-955e-f848399679c8 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:57.503955 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a598bcc2-bde0-4a65-955e-f848399679c8 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1319 microversion: 2.1 time: 0.149215 May 23 11:00:57.504737 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 437/860] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:57 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:58.396850 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-6daeda2e-dfdf-49f8-92b2-5171a951f78c req-8cbc9803-16a8-4014-8c69-1e576496faa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce77c74d-3e91-4fa5-a975-9f29723b1331", "name": "network-vif-plugged", "status": "completed", "tag": "1a66911b-a3d3-4782-b4f7-6527cbbddbb3"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:00:58.405084 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-6daeda2e-dfdf-49f8-92b2-5171a951f78c req-8cbc9803-16a8-4014-8c69-1e576496faa4 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:58.405525 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-6daeda2e-dfdf-49f8-92b2-5171a951f78c req-8cbc9803-16a8-4014-8c69-1e576496faa4 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:58.419415 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-6daeda2e-dfdf-49f8-92b2-5171a951f78c req-8cbc9803-16a8-4014-8c69-1e576496faa4 service nova] Creating event network-vif-plugged:1a66911b-a3d3-4782-b4f7-6527cbbddbb3 for instance ce77c74d-3e91-4fa5-a975-9f29723b1331 on hv-cinder-83699 May 23 11:00:58.424837 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-6daeda2e-dfdf-49f8-92b2-5171a951f78c req-8cbc9803-16a8-4014-8c69-1e576496faa4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031920 May 23 11:00:58.425474 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 424/861] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:00:58.523015 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fdc532b0-073d-4671-921e-d55398d211d2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:58.523630 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-fdc532b0-073d-4671-921e-d55398d211d2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:58.530567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fdc532b0-073d-4671-921e-d55398d211d2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:58.531017 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fdc532b0-073d-4671-921e-d55398d211d2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:58.532364 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fdc532b0-073d-4671-921e-d55398d211d2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:58.532800 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fdc532b0-073d-4671-921e-d55398d211d2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:58.663128 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fdc532b0-073d-4671-921e-d55398d211d2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:58.670546 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fdc532b0-073d-4671-921e-d55398d211d2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1319 microversion: 2.1 time: 0.151576 May 23 11:00:58.671231 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 438/862] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:58 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:00:59.688830 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c807485d-f5b2-465f-b863-07bdbee85507 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:00:59.689533 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c807485d-f5b2-465f-b863-07bdbee85507 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:00:59.696094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c807485d-f5b2-465f-b863-07bdbee85507 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:59.696548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c807485d-f5b2-465f-b863-07bdbee85507 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:59.697323 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c807485d-f5b2-465f-b863-07bdbee85507 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:00:59.697765 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c807485d-f5b2-465f-b863-07bdbee85507 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:00:59.829008 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c807485d-f5b2-465f-b863-07bdbee85507 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:00:59.836682 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c807485d-f5b2-465f-b863-07bdbee85507 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1319 microversion: 2.1 time: 0.153144 May 23 11:00:59.837240 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 425/863] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:00:59 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:00.852913 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9ecb1f60-03c1-468a-a404-713a823446e2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:00.853526 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9ecb1f60-03c1-468a-a404-713a823446e2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:00.859985 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9ecb1f60-03c1-468a-a404-713a823446e2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:00.860436 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9ecb1f60-03c1-468a-a404-713a823446e2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:00.861213 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9ecb1f60-03c1-468a-a404-713a823446e2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:00.861654 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9ecb1f60-03c1-468a-a404-713a823446e2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:00.989056 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9ecb1f60-03c1-468a-a404-713a823446e2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:00.996468 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9ecb1f60-03c1-468a-a404-713a823446e2 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1508 microversion: 2.1 time: 0.147577 May 23 11:01:00.997036 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 439/864] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:00 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:01.012375 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ea3ac39d-378d-489d-a2a7-dfcfaeb1274c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c4301e4-fa01-4cb6-b14c-0fe220dbf41e", "device": "/dev/sdb"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:01:01.013469 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ea3ac39d-378d-489d-a2a7-dfcfaeb1274c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:01.020439 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ea3ac39d-378d-489d-a2a7-dfcfaeb1274c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:01.020894 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ea3ac39d-378d-489d-a2a7-dfcfaeb1274c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:01.021916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ea3ac39d-378d-489d-a2a7-dfcfaeb1274c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:01.022391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ea3ac39d-378d-489d-a2a7-dfcfaeb1274c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:01.274309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ea3ac39d-378d-489d-a2a7-dfcfaeb1274c tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "POST /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265611 May 23 11:01:01.275090 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 426/865] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 11:01:01 2022] POST /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:01:20.698557 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1db07d46-077a-4c4e-8cd4-37d01e8fe05e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:20.699063 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1db07d46-077a-4c4e-8cd4-37d01e8fe05e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:20.701049 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:20.701872 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=17 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:20.702564 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=30 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:20.709414 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1db07d46-077a-4c4e-8cd4-37d01e8fe05e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:20.709868 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1db07d46-077a-4c4e-8cd4-37d01e8fe05e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:20.710674 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1db07d46-077a-4c4e-8cd4-37d01e8fe05e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:20.711116 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1db07d46-077a-4c4e-8cd4-37d01e8fe05e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:20.790102 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.objects.instance [None req-1db07d46-077a-4c4e-8cd4-37d01e8fe05e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lazy-loading 'services' on Instance uuid ce77c74d-3e91-4fa5-a975-9f29723b1331 {{(pid=129029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 11:01:20.863269 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1db07d46-077a-4c4e-8cd4-37d01e8fe05e tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331/os-volume_attachments/6c4301e4-fa01-4cb6-b14c-0fe220dbf41e" status: 202 len: 0 microversion: 2.1 time: 0.168700 May 23 11:01:20.864021 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 440/866] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 11:01:20 2022] DELETE /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331/os-volume_attachments/6c4301e4-fa01-4cb6-b14c-0fe220dbf41e => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:01:21.979240 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:21.979998 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=6 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:21.980705 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:21.981374 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:21.985407 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-71b738ea-2cdc-4f05-b694-e939d86b3538 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:21.986006 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-71b738ea-2cdc-4f05-b694-e939d86b3538 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:21.995233 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-71b738ea-2cdc-4f05-b694-e939d86b3538 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:21.995680 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-71b738ea-2cdc-4f05-b694-e939d86b3538 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:21.996445 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-71b738ea-2cdc-4f05-b694-e939d86b3538 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:21.996883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-71b738ea-2cdc-4f05-b694-e939d86b3538 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:22.021777 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-71b738ea-2cdc-4f05-b694-e939d86b3538 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Going to try to terminate instance {{(pid=129030) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 11:01:22.101423 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-71b738ea-2cdc-4f05-b694-e939d86b3538 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 204 len: 0 microversion: 2.1 time: 0.123298 May 23 11:01:22.105588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 427/867] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 11:01:21 2022] DELETE /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 11:01:22.112795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6c02b9e9-6cef-4bfa-927d-1fb87b0d870d tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:22.113862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6c02b9e9-6cef-4bfa-927d-1fb87b0d870d tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:22.120137 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6c02b9e9-6cef-4bfa-927d-1fb87b0d870d tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:22.120582 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6c02b9e9-6cef-4bfa-927d-1fb87b0d870d tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:22.121356 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6c02b9e9-6cef-4bfa-927d-1fb87b0d870d tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:22.121796 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6c02b9e9-6cef-4bfa-927d-1fb87b0d870d tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:22.259436 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6c02b9e9-6cef-4bfa-927d-1fb87b0d870d tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:22.268123 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6c02b9e9-6cef-4bfa-927d-1fb87b0d870d tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1514 microversion: 2.1 time: 0.160544 May 23 11:01:22.268682 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 441/868] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:22 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:23.286273 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2cb925f8-a122-47eb-a797-24d449e06657 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:23.287553 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2cb925f8-a122-47eb-a797-24d449e06657 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:23.294047 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2cb925f8-a122-47eb-a797-24d449e06657 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:23.294494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2cb925f8-a122-47eb-a797-24d449e06657 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:23.295252 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2cb925f8-a122-47eb-a797-24d449e06657 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:23.295685 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2cb925f8-a122-47eb-a797-24d449e06657 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:23.422958 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2cb925f8-a122-47eb-a797-24d449e06657 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:23.430578 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2cb925f8-a122-47eb-a797-24d449e06657 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1514 microversion: 2.1 time: 0.148609 May 23 11:01:23.431153 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 428/869] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:23 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:24.439770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-938a76c8-2d4b-47fd-b06d-b61fef679619 req-8e1e0bba-0517-45ef-b6a4-3b36f3818c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce77c74d-3e91-4fa5-a975-9f29723b1331", "name": "network-vif-deleted", "tag": "1a66911b-a3d3-4782-b4f7-6527cbbddbb3"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:01:24.448003 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-078b5a61-ed9c-455c-8980-b2da689c5585 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:24.448654 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-078b5a61-ed9c-455c-8980-b2da689c5585 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:24.450182 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-938a76c8-2d4b-47fd-b06d-b61fef679619 req-8e1e0bba-0517-45ef-b6a4-3b36f3818c3a service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:24.450655 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-938a76c8-2d4b-47fd-b06d-b61fef679619 req-8e1e0bba-0517-45ef-b6a4-3b36f3818c3a service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:24.456199 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-078b5a61-ed9c-455c-8980-b2da689c5585 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:24.456669 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-078b5a61-ed9c-455c-8980-b2da689c5585 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:24.457547 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-078b5a61-ed9c-455c-8980-b2da689c5585 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:24.458127 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-078b5a61-ed9c-455c-8980-b2da689c5585 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:24.462753 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-938a76c8-2d4b-47fd-b06d-b61fef679619 req-8e1e0bba-0517-45ef-b6a4-3b36f3818c3a service nova] Creating event network-vif-deleted:1a66911b-a3d3-4782-b4f7-6527cbbddbb3 for instance ce77c74d-3e91-4fa5-a975-9f29723b1331 on hv-cinder-83699 May 23 11:01:24.467667 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-938a76c8-2d4b-47fd-b06d-b61fef679619 req-8e1e0bba-0517-45ef-b6a4-3b36f3818c3a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031623 May 23 11:01:24.468631 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 442/870] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:01:24.523380 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-078b5a61-ed9c-455c-8980-b2da689c5585 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c5c03daed4679afee0143e6e99a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7e29a1e59b43a4a35f700a7e1be42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:24.530916 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-078b5a61-ed9c-455c-8980-b2da689c5585 tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 200 len: 1472 microversion: 2.1 time: 0.087091 May 23 11:01:24.531493 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 429/871] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:24 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 1472 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 11:01:25.549707 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-09a5ebc3-2f44-4199-9531-08721503200b tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:25.550446 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-09a5ebc3-2f44-4199-9531-08721503200b tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] [instance: ce77c74d-3e91-4fa5-a975-9f29723b1331] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:25.557100 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-09a5ebc3-2f44-4199-9531-08721503200b tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:25.557557 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-09a5ebc3-2f44-4199-9531-08721503200b tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:25.558356 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-09a5ebc3-2f44-4199-9531-08721503200b tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:25.558817 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-09a5ebc3-2f44-4199-9531-08721503200b tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:25.572598 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-09a5ebc3-2f44-4199-9531-08721503200b tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] HTTP exception thrown: Instance ce77c74d-3e91-4fa5-a975-9f29723b1331 could not be found. May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-09a5ebc3-2f44-4199-9531-08721503200b tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Request method failure captured: May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 HTTP/1.1 May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2kZ_tgLUUkHraTkppiotJRbp4qKhD3DyulpvHiFDoJA7pIsCU-WDxqJs4TONfX4XXvtUrjnTSLbFOeoxSSAJKdkqUEfgmdnAFAB7ZAdBJtjnMNJvQuwdu9woUdpgpo9QNWXlErBM84aC1oO7djx4_tw2DJJL12sCV7X6qsYcVGDOL0 May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 0c7e29a1e59b43a4a35f700a7e1be42c May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-VolumesSnapshotTestJSON-979774303 May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 11:01:25.574255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c7e29a1e59b43a4a35f700a7e1be42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c7e29a1e59b43a4a35f700a7e1be42c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c7e29a1e59b43a4a35f700a7e1be42c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c7e29a1e59b43a4a35f700a7e1be42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-VolumesSnapshotTestJSON-979774303 May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 0c7e29a1e59b43a4a35f700a7e1be42c May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-979774303 May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-VolumesSnapshotTestJSON-979774303-project May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: dd2c5c03daed4679afee0143e6e99a68 May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-VolumesSnapshotTestJSON-979774303-project May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance ce77c74d-3e91-4fa5-a975-9f29723b1331 could not be found. May 23 11:01:25.575710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'ce77c74d-3e91-4fa5-a975-9f29723b1331'} May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce77c74d-3e91-4fa5-a975-9f29723b1331 could not be found. May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 11:01:25.576490 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce77c74d-3e91-4fa5-a975-9f29723b1331 could not be found. May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce77c74d-3e91-4fa5-a975-9f29723b1331 could not be found. May 23 11:01:25.578042 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:01:25.579653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-09a5ebc3-2f44-4199-9531-08721503200b tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] Returning 404 to user: Instance ce77c74d-3e91-4fa5-a975-9f29723b1331 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 11:01:25.579653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-09a5ebc3-2f44-4199-9531-08721503200b tempest-VolumesSnapshotTestJSON-979774303 tempest-VolumesSnapshotTestJSON-979774303-project] 10.222.0.36 "GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331" status: 404 len: 111 microversion: 2.1 time: 0.030797 May 23 11:01:25.579653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 443/872] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:25 2022] GET /compute/v2.1/servers/ce77c74d-3e91-4fa5-a975-9f29723b1331 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 11:01:37.963002 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-76722590-12a2-447c-87ad-b7231d7c418c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:01:37.963601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-76722590-12a2-447c-87ad-b7231d7c418c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:37.966100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:37.966754 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:37.972655 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76722590-12a2-447c-87ad-b7231d7c418c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:37.973096 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76722590-12a2-447c-87ad-b7231d7c418c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:37.973881 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76722590-12a2-447c-87ad-b7231d7c418c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:37.974375 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-76722590-12a2-447c-87ad-b7231d7c418c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:37.997066 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-76722590-12a2-447c-87ad-b7231d7c418c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lazy-loading 'flavor' on Instance uuid 32b27c20-a6cd-4dd3-9506-1d132be6e635 {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 11:01:38.067740 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-76722590-12a2-447c-87ad-b7231d7c418c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "POST /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635/action" status: 202 len: 0 microversion: 2.1 time: 0.108438 May 23 11:01:38.068320 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 430/873] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 11:01:37 2022] POST /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:01:38.078168 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-7a57b675-470b-44dc-89cc-aebea7376e19 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:38.078560 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-7a57b675-470b-44dc-89cc-aebea7376e19 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:38.080659 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=8 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:38.082179 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:01:38.088502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7a57b675-470b-44dc-89cc-aebea7376e19 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:38.089016 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7a57b675-470b-44dc-89cc-aebea7376e19 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:38.090816 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7a57b675-470b-44dc-89cc-aebea7376e19 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:38.091273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7a57b675-470b-44dc-89cc-aebea7376e19 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:38.226124 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-7a57b675-470b-44dc-89cc-aebea7376e19 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:38.234310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-7a57b675-470b-44dc-89cc-aebea7376e19 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.161247 May 23 11:01:38.235167 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 444/874] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:38 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:39.253808 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-59b27495-9ef0-4e3a-bd7a-45125100d991 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:39.254665 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-59b27495-9ef0-4e3a-bd7a-45125100d991 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:39.260984 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-59b27495-9ef0-4e3a-bd7a-45125100d991 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:39.261489 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-59b27495-9ef0-4e3a-bd7a-45125100d991 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:39.262292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-59b27495-9ef0-4e3a-bd7a-45125100d991 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:39.262735 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-59b27495-9ef0-4e3a-bd7a-45125100d991 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:39.391909 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-59b27495-9ef0-4e3a-bd7a-45125100d991 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:39.400378 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-59b27495-9ef0-4e3a-bd7a-45125100d991 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.151805 May 23 11:01:39.400944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 431/875] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:39 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:40.417425 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-72dc15e0-c9e4-48f6-a3a8-1b1cb6acafa3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:40.418252 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-72dc15e0-c9e4-48f6-a3a8-1b1cb6acafa3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:40.424838 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-72dc15e0-c9e4-48f6-a3a8-1b1cb6acafa3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:40.425290 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-72dc15e0-c9e4-48f6-a3a8-1b1cb6acafa3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:40.426087 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-72dc15e0-c9e4-48f6-a3a8-1b1cb6acafa3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:40.426531 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-72dc15e0-c9e4-48f6-a3a8-1b1cb6acafa3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:40.662860 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-72dc15e0-c9e4-48f6-a3a8-1b1cb6acafa3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:40.670315 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-72dc15e0-c9e4-48f6-a3a8-1b1cb6acafa3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.256690 May 23 11:01:40.670880 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 445/876] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:40 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:41.687214 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5667c9fa-667c-4a87-b80e-24e23614df84 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:41.687817 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5667c9fa-667c-4a87-b80e-24e23614df84 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:41.694345 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5667c9fa-667c-4a87-b80e-24e23614df84 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:41.694785 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5667c9fa-667c-4a87-b80e-24e23614df84 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:41.695541 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5667c9fa-667c-4a87-b80e-24e23614df84 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:41.695970 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5667c9fa-667c-4a87-b80e-24e23614df84 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:41.882089 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5667c9fa-667c-4a87-b80e-24e23614df84 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:41.889997 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5667c9fa-667c-4a87-b80e-24e23614df84 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.206572 May 23 11:01:41.890730 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 432/877] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:41 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:42.907735 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3bdab4df-66dc-4ab5-af6b-fd32bc7bd0bc tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:42.908328 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3bdab4df-66dc-4ab5-af6b-fd32bc7bd0bc tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:42.914798 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3bdab4df-66dc-4ab5-af6b-fd32bc7bd0bc tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:42.915244 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3bdab4df-66dc-4ab5-af6b-fd32bc7bd0bc tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:42.915996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3bdab4df-66dc-4ab5-af6b-fd32bc7bd0bc tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:42.916428 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3bdab4df-66dc-4ab5-af6b-fd32bc7bd0bc tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:43.052197 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3bdab4df-66dc-4ab5-af6b-fd32bc7bd0bc tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:43.060127 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3bdab4df-66dc-4ab5-af6b-fd32bc7bd0bc tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.156193 May 23 11:01:43.060688 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 446/878] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:42 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:44.077153 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ce0685f6-bec2-4392-8f68-c1bc47e6f7d5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:44.077773 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ce0685f6-bec2-4392-8f68-c1bc47e6f7d5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:44.084942 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ce0685f6-bec2-4392-8f68-c1bc47e6f7d5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:44.085400 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ce0685f6-bec2-4392-8f68-c1bc47e6f7d5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:44.086233 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ce0685f6-bec2-4392-8f68-c1bc47e6f7d5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:44.086686 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ce0685f6-bec2-4392-8f68-c1bc47e6f7d5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:44.219610 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ce0685f6-bec2-4392-8f68-c1bc47e6f7d5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:44.227152 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ce0685f6-bec2-4392-8f68-c1bc47e6f7d5 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.153881 May 23 11:01:44.227727 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 433/879] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:44 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:45.245307 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-59a90154-e504-48d0-8e4e-958d496532b3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:45.245982 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-59a90154-e504-48d0-8e4e-958d496532b3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:45.252073 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59a90154-e504-48d0-8e4e-958d496532b3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:45.252520 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59a90154-e504-48d0-8e4e-958d496532b3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:45.253790 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59a90154-e504-48d0-8e4e-958d496532b3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:45.254487 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-59a90154-e504-48d0-8e4e-958d496532b3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:45.390261 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-59a90154-e504-48d0-8e4e-958d496532b3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:45.398728 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-59a90154-e504-48d0-8e4e-958d496532b3 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.158960 May 23 11:01:45.399299 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 447/880] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:45 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:46.416773 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-da8c2664-39f1-469c-8e20-a6f10c657ef9 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:46.417349 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-da8c2664-39f1-469c-8e20-a6f10c657ef9 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:46.423911 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-da8c2664-39f1-469c-8e20-a6f10c657ef9 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:46.424365 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-da8c2664-39f1-469c-8e20-a6f10c657ef9 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:46.425132 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-da8c2664-39f1-469c-8e20-a6f10c657ef9 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:46.425576 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-da8c2664-39f1-469c-8e20-a6f10c657ef9 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:46.558600 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-da8c2664-39f1-469c-8e20-a6f10c657ef9 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:46.566426 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-da8c2664-39f1-469c-8e20-a6f10c657ef9 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.153533 May 23 11:01:46.567078 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 434/881] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:46 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:47.583645 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-db803188-73f5-4e7d-9339-22e8da83132c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:47.584329 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-db803188-73f5-4e7d-9339-22e8da83132c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:47.590848 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-db803188-73f5-4e7d-9339-22e8da83132c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:47.591632 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-db803188-73f5-4e7d-9339-22e8da83132c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:47.592154 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-db803188-73f5-4e7d-9339-22e8da83132c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:47.592707 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-db803188-73f5-4e7d-9339-22e8da83132c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:47.813049 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-db803188-73f5-4e7d-9339-22e8da83132c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:47.821001 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-db803188-73f5-4e7d-9339-22e8da83132c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.241227 May 23 11:01:47.821565 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 448/882] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:47 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:48.838095 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-82788c53-ba48-4ae0-969d-739d4c4d93d2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:48.838714 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-82788c53-ba48-4ae0-969d-739d4c4d93d2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:48.845368 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-82788c53-ba48-4ae0-969d-739d4c4d93d2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:48.845823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-82788c53-ba48-4ae0-969d-739d4c4d93d2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:48.846657 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-82788c53-ba48-4ae0-969d-739d4c4d93d2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:48.847071 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-82788c53-ba48-4ae0-969d-739d4c4d93d2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:49.058603 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-82788c53-ba48-4ae0-969d-739d4c4d93d2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:49.066309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-82788c53-ba48-4ae0-969d-739d4c4d93d2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.232068 May 23 11:01:49.066900 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 435/883] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:48 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:50.083422 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-833eb537-6c63-4fb9-9179-53c4d6a2e36e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:50.084038 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-833eb537-6c63-4fb9-9179-53c4d6a2e36e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:50.090704 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-833eb537-6c63-4fb9-9179-53c4d6a2e36e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:50.091021 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-833eb537-6c63-4fb9-9179-53c4d6a2e36e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:50.092102 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-833eb537-6c63-4fb9-9179-53c4d6a2e36e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:50.092711 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-833eb537-6c63-4fb9-9179-53c4d6a2e36e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:50.338577 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-833eb537-6c63-4fb9-9179-53c4d6a2e36e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:50.347643 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-833eb537-6c63-4fb9-9179-53c4d6a2e36e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.268136 May 23 11:01:50.348548 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 449/884] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:50 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:51.365267 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ddb94d29-2aab-4497-9a21-a26c2dcab672 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:51.366100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ddb94d29-2aab-4497-9a21-a26c2dcab672 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:51.374716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ddb94d29-2aab-4497-9a21-a26c2dcab672 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:51.375450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ddb94d29-2aab-4497-9a21-a26c2dcab672 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:51.376416 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ddb94d29-2aab-4497-9a21-a26c2dcab672 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:51.377022 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ddb94d29-2aab-4497-9a21-a26c2dcab672 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:51.626044 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ddb94d29-2aab-4497-9a21-a26c2dcab672 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:51.643094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ddb94d29-2aab-4497-9a21-a26c2dcab672 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.282015 May 23 11:01:51.655152 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 436/885] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:51 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:52.663174 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-7fc2fcf2-5c97-481e-93f6-5e06aaa62a49 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:52.663787 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-7fc2fcf2-5c97-481e-93f6-5e06aaa62a49 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:52.670704 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7fc2fcf2-5c97-481e-93f6-5e06aaa62a49 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:52.671721 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7fc2fcf2-5c97-481e-93f6-5e06aaa62a49 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:52.672536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7fc2fcf2-5c97-481e-93f6-5e06aaa62a49 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:52.672975 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-7fc2fcf2-5c97-481e-93f6-5e06aaa62a49 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:52.823563 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-7fc2fcf2-5c97-481e-93f6-5e06aaa62a49 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:52.833944 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-7fc2fcf2-5c97-481e-93f6-5e06aaa62a49 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1510 microversion: 2.1 time: 0.175835 May 23 11:01:52.834881 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 450/886] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:52 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:52.851715 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5bf24ee7-251b-4950-ac7a-962098876c1b tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:01:52.852296 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5bf24ee7-251b-4950-ac7a-962098876c1b tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:52.858944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5bf24ee7-251b-4950-ac7a-962098876c1b tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:52.859397 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5bf24ee7-251b-4950-ac7a-962098876c1b tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:52.860387 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5bf24ee7-251b-4950-ac7a-962098876c1b tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:52.860994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5bf24ee7-251b-4950-ac7a-962098876c1b tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:52.948452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5bf24ee7-251b-4950-ac7a-962098876c1b tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "POST /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635/action" status: 202 len: 0 microversion: 2.1 time: 0.100549 May 23 11:01:52.949263 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 437/887] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 11:01:52 2022] POST /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:01:52.958607 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3b57cebc-d66b-458d-af45-d2f6eba70653 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:52.959416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3b57cebc-d66b-458d-af45-d2f6eba70653 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:52.966168 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3b57cebc-d66b-458d-af45-d2f6eba70653 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:52.966703 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3b57cebc-d66b-458d-af45-d2f6eba70653 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:52.967722 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3b57cebc-d66b-458d-af45-d2f6eba70653 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:52.968625 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3b57cebc-d66b-458d-af45-d2f6eba70653 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:53.199071 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3b57cebc-d66b-458d-af45-d2f6eba70653 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:53.207781 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3b57cebc-d66b-458d-af45-d2f6eba70653 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1518 microversion: 2.1 time: 0.253652 May 23 11:01:53.208358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 451/888] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:52 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1518 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:54.228553 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9cb413b5-d2d2-4a83-8a94-d52092fda5d4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:54.231032 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9cb413b5-d2d2-4a83-8a94-d52092fda5d4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:54.241569 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9cb413b5-d2d2-4a83-8a94-d52092fda5d4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:54.255793 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9cb413b5-d2d2-4a83-8a94-d52092fda5d4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:54.258336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9cb413b5-d2d2-4a83-8a94-d52092fda5d4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:54.258955 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9cb413b5-d2d2-4a83-8a94-d52092fda5d4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:54.509247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-9cb413b5-d2d2-4a83-8a94-d52092fda5d4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:54.519431 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9cb413b5-d2d2-4a83-8a94-d52092fda5d4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1518 microversion: 2.1 time: 0.297609 May 23 11:01:54.520018 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 438/889] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:54 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1518 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:54.658887 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-a77d1589-9945-491b-b098-e5a84084f9db req-b5146fed-5eda-4972-b89c-3a0762c7f331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b27c20-a6cd-4dd3-9506-1d132be6e635", "name": "network-vif-unplugged", "status": "completed", "tag": "28a6a33f-244e-40a2-b8a1-14db1a5fb3ba"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:01:54.668183 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-a77d1589-9945-491b-b098-e5a84084f9db req-b5146fed-5eda-4972-b89c-3a0762c7f331 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:54.668646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-a77d1589-9945-491b-b098-e5a84084f9db req-b5146fed-5eda-4972-b89c-3a0762c7f331 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:54.694325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.compute.server_external_events [req-a77d1589-9945-491b-b098-e5a84084f9db req-b5146fed-5eda-4972-b89c-3a0762c7f331 service nova] Unable to find a host for instance 32b27c20-a6cd-4dd3-9506-1d132be6e635. Dropping event network-vif-unplugged {{(pid=129029) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 11:01:54.695943 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-a77d1589-9945-491b-b098-e5a84084f9db req-b5146fed-5eda-4972-b89c-3a0762c7f331 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040791 May 23 11:01:54.696780 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 452/890] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 23 11:01:55.537943 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2dfbe119-6f29-477b-af6a-e4e0d367f35a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:55.539337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2dfbe119-6f29-477b-af6a-e4e0d367f35a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:55.547488 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2dfbe119-6f29-477b-af6a-e4e0d367f35a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:55.550049 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2dfbe119-6f29-477b-af6a-e4e0d367f35a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:55.557435 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2dfbe119-6f29-477b-af6a-e4e0d367f35a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:55.558120 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2dfbe119-6f29-477b-af6a-e4e0d367f35a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:55.768808 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2dfbe119-6f29-477b-af6a-e4e0d367f35a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:55.791034 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2dfbe119-6f29-477b-af6a-e4e0d367f35a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.256500 May 23 11:01:55.802636 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 439/891] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:55 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:56.811362 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c65881cc-67cc-4b5c-a7f4-9d52b77e111e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:56.812635 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c65881cc-67cc-4b5c-a7f4-9d52b77e111e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:56.831392 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c65881cc-67cc-4b5c-a7f4-9d52b77e111e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:56.832753 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c65881cc-67cc-4b5c-a7f4-9d52b77e111e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:56.833552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c65881cc-67cc-4b5c-a7f4-9d52b77e111e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:56.861391 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c65881cc-67cc-4b5c-a7f4-9d52b77e111e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:57.142037 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c65881cc-67cc-4b5c-a7f4-9d52b77e111e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:57.158517 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c65881cc-67cc-4b5c-a7f4-9d52b77e111e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.353621 May 23 11:01:57.159661 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 453/892] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:56 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:58.178612 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-087f1de7-b5e6-449a-a580-4aa601b4201f tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:58.179841 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-087f1de7-b5e6-449a-a580-4aa601b4201f tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:58.195093 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-087f1de7-b5e6-449a-a580-4aa601b4201f tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:58.195804 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-087f1de7-b5e6-449a-a580-4aa601b4201f tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:58.196762 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-087f1de7-b5e6-449a-a580-4aa601b4201f tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:58.197631 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-087f1de7-b5e6-449a-a580-4aa601b4201f tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:58.429855 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-087f1de7-b5e6-449a-a580-4aa601b4201f tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:58.440508 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-087f1de7-b5e6-449a-a580-4aa601b4201f tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.268032 May 23 11:01:58.451052 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 440/893] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:58 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:59.457545 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-fa8a7a94-b227-48d5-ada7-b5ac347080e4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:01:59.459080 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-fa8a7a94-b227-48d5-ada7-b5ac347080e4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:01:59.467313 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa8a7a94-b227-48d5-ada7-b5ac347080e4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:59.467766 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa8a7a94-b227-48d5-ada7-b5ac347080e4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:59.468534 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa8a7a94-b227-48d5-ada7-b5ac347080e4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:01:59.468977 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-fa8a7a94-b227-48d5-ada7-b5ac347080e4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:01:59.651288 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-fa8a7a94-b227-48d5-ada7-b5ac347080e4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:01:59.662321 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-fa8a7a94-b227-48d5-ada7-b5ac347080e4 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.208688 May 23 11:01:59.663619 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 454/894] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:01:59 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:01:59.987294 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:01:59.987536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Mon May 23 11:01:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 11:02:00.681615 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b71daa43-0e35-4821-b2bb-7f627f7fcd07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:00.682949 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b71daa43-0e35-4821-b2bb-7f627f7fcd07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:00.690414 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b71daa43-0e35-4821-b2bb-7f627f7fcd07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:00.691182 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b71daa43-0e35-4821-b2bb-7f627f7fcd07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:00.692736 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b71daa43-0e35-4821-b2bb-7f627f7fcd07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:00.693418 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b71daa43-0e35-4821-b2bb-7f627f7fcd07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:00.877089 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b71daa43-0e35-4821-b2bb-7f627f7fcd07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:00.892242 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b71daa43-0e35-4821-b2bb-7f627f7fcd07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.215138 May 23 11:02:00.902472 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 441/895] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:00 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:01.908708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5685b5f0-2c44-4885-ad16-5dfeca85e37e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:01.910898 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5685b5f0-2c44-4885-ad16-5dfeca85e37e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:01.917902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5685b5f0-2c44-4885-ad16-5dfeca85e37e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:01.918716 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5685b5f0-2c44-4885-ad16-5dfeca85e37e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:01.919924 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5685b5f0-2c44-4885-ad16-5dfeca85e37e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:01.920600 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5685b5f0-2c44-4885-ad16-5dfeca85e37e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:02.081763 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5685b5f0-2c44-4885-ad16-5dfeca85e37e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:02.091071 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5685b5f0-2c44-4885-ad16-5dfeca85e37e tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.186275 May 23 11:02:02.101724 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 455/896] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:01 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:03.110776 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-aa66c51a-8e00-46ad-9dd4-189e1d30e6b8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:03.112165 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-aa66c51a-8e00-46ad-9dd4-189e1d30e6b8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:03.125103 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aa66c51a-8e00-46ad-9dd4-189e1d30e6b8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:03.127699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aa66c51a-8e00-46ad-9dd4-189e1d30e6b8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:03.130163 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aa66c51a-8e00-46ad-9dd4-189e1d30e6b8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:03.131091 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aa66c51a-8e00-46ad-9dd4-189e1d30e6b8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:03.322410 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aa66c51a-8e00-46ad-9dd4-189e1d30e6b8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:03.335718 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-aa66c51a-8e00-46ad-9dd4-189e1d30e6b8 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.230084 May 23 11:02:03.348272 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 442/897] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:03 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:04.353126 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a4defffd-6612-4f42-8870-434c87643381 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:04.353737 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a4defffd-6612-4f42-8870-434c87643381 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:04.360540 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a4defffd-6612-4f42-8870-434c87643381 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:04.361193 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a4defffd-6612-4f42-8870-434c87643381 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:04.362177 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a4defffd-6612-4f42-8870-434c87643381 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:04.362795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a4defffd-6612-4f42-8870-434c87643381 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:04.502574 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a4defffd-6612-4f42-8870-434c87643381 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:04.511243 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a4defffd-6612-4f42-8870-434c87643381 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.162409 May 23 11:02:04.511731 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 456/898] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:04 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 11:02:05.529503 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-74ac04f0-003f-4a9c-bd05-39e71a21e484 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:05.530345 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-74ac04f0-003f-4a9c-bd05-39e71a21e484 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:05.537575 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-74ac04f0-003f-4a9c-bd05-39e71a21e484 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:05.538272 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-74ac04f0-003f-4a9c-bd05-39e71a21e484 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:05.539118 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-74ac04f0-003f-4a9c-bd05-39e71a21e484 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:05.539762 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-74ac04f0-003f-4a9c-bd05-39e71a21e484 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:05.563198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:05.691258 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-74ac04f0-003f-4a9c-bd05-39e71a21e484 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:05.699363 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-74ac04f0-003f-4a9c-bd05-39e71a21e484 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.174371 May 23 11:02:05.699950 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 443/899] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:05 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:06.716380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-1ae023cd-6447-4757-8a52-1ed36b23dee0 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:06.717004 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-1ae023cd-6447-4757-8a52-1ed36b23dee0 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:06.724109 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ae023cd-6447-4757-8a52-1ed36b23dee0 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:06.724887 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ae023cd-6447-4757-8a52-1ed36b23dee0 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:06.725904 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ae023cd-6447-4757-8a52-1ed36b23dee0 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:06.726572 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-1ae023cd-6447-4757-8a52-1ed36b23dee0 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:06.795373 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-e656bd42-db26-4653-a2aa-692c3d1eb876 req-1cfc464d-7b30-41d1-9eef-bcf251b0651c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b27c20-a6cd-4dd3-9506-1d132be6e635", "name": "network-vif-plugged", "status": "completed", "tag": "28a6a33f-244e-40a2-b8a1-14db1a5fb3ba"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:06.812220 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-e656bd42-db26-4653-a2aa-692c3d1eb876 req-1cfc464d-7b30-41d1-9eef-bcf251b0651c service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:06.812979 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-e656bd42-db26-4653-a2aa-692c3d1eb876 req-1cfc464d-7b30-41d1-9eef-bcf251b0651c service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:06.829934 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-e656bd42-db26-4653-a2aa-692c3d1eb876 req-1cfc464d-7b30-41d1-9eef-bcf251b0651c service nova] Creating event network-vif-plugged:28a6a33f-244e-40a2-b8a1-14db1a5fb3ba for instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 on hv-cinder-83699 May 23 11:02:06.835783 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-e656bd42-db26-4653-a2aa-692c3d1eb876 req-1cfc464d-7b30-41d1-9eef-bcf251b0651c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044025 May 23 11:02:06.836698 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 444/900] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:06.896591 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-1ae023cd-6447-4757-8a52-1ed36b23dee0 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:06.909755 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-1ae023cd-6447-4757-8a52-1ed36b23dee0 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.196365 May 23 11:02:06.911527 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 457/901] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:06 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:07.928711 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-90a0bd89-ac69-4f17-b341-75c6670d4d07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:07.929543 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-90a0bd89-ac69-4f17-b341-75c6670d4d07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:07.936510 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90a0bd89-ac69-4f17-b341-75c6670d4d07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:07.937046 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90a0bd89-ac69-4f17-b341-75c6670d4d07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:07.937833 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90a0bd89-ac69-4f17-b341-75c6670d4d07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:07.938301 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-90a0bd89-ac69-4f17-b341-75c6670d4d07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:08.089181 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-90a0bd89-ac69-4f17-b341-75c6670d4d07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:08.098184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-90a0bd89-ac69-4f17-b341-75c6670d4d07 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1576 microversion: 2.1 time: 0.173623 May 23 11:02:08.099052 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 445/902] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:07 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:08.310728 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-851c616a-a83f-4d63-8c52-d1068fc18b32 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Action: 'create', calling method: .version_select at 0x7fe720077a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1563166334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8K8lACXZR6YZBLPls6wB4cyWTmrZX/CTj1YCSGr1rHttAtMWNXD5ugjph1tmSvCseTleU/rbPw4OOd/cykmYWI+D5uCTNcnStCNgtgrrq2vuq2SALNj//wsmPAa/bjqQ=="}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:08.315016 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=29 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:08.327029 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-851c616a-a83f-4d63-8c52-d1068fc18b32 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Getting quotas for project e35c886cdaaf465eacd001e132128cbd. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 11:02:08.330999 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-851c616a-a83f-4d63-8c52-d1068fc18b32 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Getting quotas for user 88701ef1915d4ad2955a4bf31fe7634b and project e35c886cdaaf465eacd001e132128cbd. Resources: {'key_pairs'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 11:02:08.354271 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-851c616a-a83f-4d63-8c52-d1068fc18b32 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047337 May 23 11:02:08.354812 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 458/903] 10.222.0.36 () {60 vars in 1158 bytes} [Mon May 23 11:02:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:08.402100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-421121465", "imageRef": "672f41c9-8a6e-421a-9c02-caa17e4a9070", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1563166334", "networks": [{"uuid": "02caa7bb-033c-4bb4-9db6-9d42dcf638aa"}]}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:08.408766 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=35 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:08.451175 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.network.neutron [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] validate_networks() for [('02caa7bb-033c-4bb4-9db6-9d42dcf638aa', None, None, None, None, None)] {{(pid=129030) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 11:02:08.817581 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Flavor limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 11:02:08.818073 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Image limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 11:02:08.818551 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Flavor pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 11:02:08.818962 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Image pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 11:02:08.819419 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 11:02:08.829067 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:08.829517 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:08.830360 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:08.830802 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:08.847187 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Getting quotas for project e35c886cdaaf465eacd001e132128cbd. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 11:02:08.851132 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Getting quotas for user 88701ef1915d4ad2955a4bf31fe7634b and project e35c886cdaaf465eacd001e132128cbd. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 11:02:08.861872 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Going to run 1 instances... {{(pid=129030) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 11:02:08.864600 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='672f41c9-8a6e-421a-9c02-caa17e4a9070',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 11:02:08.910559 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0e2d6bd8-dec5-4ff7-9c5c-92dde3217f1d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512428 May 23 11:02:08.911141 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 446/904] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 11:02:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 11:02:08.920761 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d0708165-8bb3-471f-ab57-4740cb348bef tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:08.921374 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d0708165-8bb3-471f-ab57-4740cb348bef tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:08.976327 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d0708165-8bb3-471f-ab57-4740cb348bef tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:08.983154 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d0708165-8bb3-471f-ab57-4740cb348bef tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1258 microversion: 2.1 time: 0.066173 May 23 11:02:08.993623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 459/905] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:08 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:09.117079 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-31e01475-0a9b-479e-9cc6-501ef8d3014c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:09.117695 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-31e01475-0a9b-479e-9cc6-501ef8d3014c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:09.124112 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-31e01475-0a9b-479e-9cc6-501ef8d3014c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:09.124567 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-31e01475-0a9b-479e-9cc6-501ef8d3014c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:09.125368 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-31e01475-0a9b-479e-9cc6-501ef8d3014c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:09.125809 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-31e01475-0a9b-479e-9cc6-501ef8d3014c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:09.264181 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-31e01475-0a9b-479e-9cc6-501ef8d3014c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:09.273335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-31e01475-0a9b-479e-9cc6-501ef8d3014c tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1563 microversion: 2.1 time: 0.161272 May 23 11:02:09.273903 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 447/906] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:09 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:10.000613 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-88078114-45bb-42b8-b06e-7308b406479d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:10.002145 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-88078114-45bb-42b8-b06e-7308b406479d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:10.009140 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-88078114-45bb-42b8-b06e-7308b406479d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:10.009847 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-88078114-45bb-42b8-b06e-7308b406479d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:10.010884 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-88078114-45bb-42b8-b06e-7308b406479d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:10.011825 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-88078114-45bb-42b8-b06e-7308b406479d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:10.014895 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=81 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:10.075756 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-88078114-45bb-42b8-b06e-7308b406479d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:10.083844 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-88078114-45bb-42b8-b06e-7308b406479d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1316 microversion: 2.1 time: 0.087111 May 23 11:02:10.084522 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 460/907] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:09 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1316 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:11.101302 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ec556a79-4c39-4eab-8f18-c1886b2b5c2d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:11.101845 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ec556a79-4c39-4eab-8f18-c1886b2b5c2d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:11.108666 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ec556a79-4c39-4eab-8f18-c1886b2b5c2d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:11.109120 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ec556a79-4c39-4eab-8f18-c1886b2b5c2d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:11.109897 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ec556a79-4c39-4eab-8f18-c1886b2b5c2d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:11.110556 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ec556a79-4c39-4eab-8f18-c1886b2b5c2d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:11.260581 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ec556a79-4c39-4eab-8f18-c1886b2b5c2d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:11.268930 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ec556a79-4c39-4eab-8f18-c1886b2b5c2d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.171447 May 23 11:02:11.269791 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 448/908] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:11 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 11:02:12.286445 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-a878642f-48ee-4a59-a552-e6bade37edc9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:12.287166 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-a878642f-48ee-4a59-a552-e6bade37edc9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:12.294265 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a878642f-48ee-4a59-a552-e6bade37edc9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:12.294710 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a878642f-48ee-4a59-a552-e6bade37edc9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:12.296378 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a878642f-48ee-4a59-a552-e6bade37edc9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:12.296938 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-a878642f-48ee-4a59-a552-e6bade37edc9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:12.438910 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-a878642f-48ee-4a59-a552-e6bade37edc9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:12.446895 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-a878642f-48ee-4a59-a552-e6bade37edc9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.164612 May 23 11:02:12.447457 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 461/909] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:12 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:13.463889 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1254341d-d6dc-4c6b-b380-daf125e85192 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:13.464614 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1254341d-d6dc-4c6b-b380-daf125e85192 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:13.471386 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1254341d-d6dc-4c6b-b380-daf125e85192 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:13.471917 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1254341d-d6dc-4c6b-b380-daf125e85192 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:13.472706 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1254341d-d6dc-4c6b-b380-daf125e85192 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:13.473144 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1254341d-d6dc-4c6b-b380-daf125e85192 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:13.609063 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1254341d-d6dc-4c6b-b380-daf125e85192 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:13.617871 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1254341d-d6dc-4c6b-b380-daf125e85192 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.158004 May 23 11:02:13.618683 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 449/910] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:13 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:14.633649 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-184dc1e1-6436-40ef-a834-9342991c7c33 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:14.634388 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-184dc1e1-6436-40ef-a834-9342991c7c33 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:14.641714 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-184dc1e1-6436-40ef-a834-9342991c7c33 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:14.642195 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-184dc1e1-6436-40ef-a834-9342991c7c33 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:14.642975 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-184dc1e1-6436-40ef-a834-9342991c7c33 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:14.643416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-184dc1e1-6436-40ef-a834-9342991c7c33 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:14.793641 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-184dc1e1-6436-40ef-a834-9342991c7c33 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:14.802194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-184dc1e1-6436-40ef-a834-9342991c7c33 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.172305 May 23 11:02:14.802769 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 462/911] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:14 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:15.819959 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-49b473e3-9069-429f-9830-4f0bc500131c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:15.820685 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-49b473e3-9069-429f-9830-4f0bc500131c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:15.828380 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49b473e3-9069-429f-9830-4f0bc500131c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:15.828939 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49b473e3-9069-429f-9830-4f0bc500131c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:15.829824 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49b473e3-9069-429f-9830-4f0bc500131c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:15.830356 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-49b473e3-9069-429f-9830-4f0bc500131c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:15.966048 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-49b473e3-9069-429f-9830-4f0bc500131c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:15.974223 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-49b473e3-9069-429f-9830-4f0bc500131c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.159066 May 23 11:02:15.974851 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 450/912] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:15 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:16.991087 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f24cb82f-33fe-476e-af71-b2f602a2d391 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:16.991717 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f24cb82f-33fe-476e-af71-b2f602a2d391 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:16.998369 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f24cb82f-33fe-476e-af71-b2f602a2d391 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:16.998822 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f24cb82f-33fe-476e-af71-b2f602a2d391 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:16.999603 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f24cb82f-33fe-476e-af71-b2f602a2d391 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:17.000040 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f24cb82f-33fe-476e-af71-b2f602a2d391 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:17.140092 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f24cb82f-33fe-476e-af71-b2f602a2d391 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:17.147647 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f24cb82f-33fe-476e-af71-b2f602a2d391 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.160888 May 23 11:02:17.148609 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 463/913] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:16 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:18.165673 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1ce9e16f-8887-4930-9d1c-3d544644af56 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:18.166332 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1ce9e16f-8887-4930-9d1c-3d544644af56 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:18.172761 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ce9e16f-8887-4930-9d1c-3d544644af56 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:18.173207 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ce9e16f-8887-4930-9d1c-3d544644af56 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:18.174034 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ce9e16f-8887-4930-9d1c-3d544644af56 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:18.174475 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1ce9e16f-8887-4930-9d1c-3d544644af56 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:18.365922 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1ce9e16f-8887-4930-9d1c-3d544644af56 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:18.373392 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1ce9e16f-8887-4930-9d1c-3d544644af56 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.211559 May 23 11:02:18.374185 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 451/914] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:18 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:18.980614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=6 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:19.074411 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-6d180f17-64f8-416c-9b0e-cfcf45173208 req-530845c8-6c0a-46ab-ab0d-79519478e153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9139f29e-ed6d-4b8c-a8f1-8b7b4899857d", "tag": "bae4a123-9d28-40c2-a622-78818f3c9569"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:19.082933 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-6d180f17-64f8-416c-9b0e-cfcf45173208 req-530845c8-6c0a-46ab-ab0d-79519478e153 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:19.083378 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-6d180f17-64f8-416c-9b0e-cfcf45173208 req-530845c8-6c0a-46ab-ab0d-79519478e153 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:19.095265 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-6d180f17-64f8-416c-9b0e-cfcf45173208 req-530845c8-6c0a-46ab-ab0d-79519478e153 service nova] Creating event network-changed:bae4a123-9d28-40c2-a622-78818f3c9569 for instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d on hv-cinder-83699 May 23 11:02:19.101070 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-6d180f17-64f8-416c-9b0e-cfcf45173208 req-530845c8-6c0a-46ab-ab0d-79519478e153 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190225 May 23 11:02:19.101785 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 464/915] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:19.390631 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-0f8fc9a0-087b-4a1b-96be-154e9fbe3cbe tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:19.391386 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-0f8fc9a0-087b-4a1b-96be-154e9fbe3cbe tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:19.394515 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:19.395363 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=6 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:19.402216 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0f8fc9a0-087b-4a1b-96be-154e9fbe3cbe tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:19.402662 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0f8fc9a0-087b-4a1b-96be-154e9fbe3cbe tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:19.403431 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0f8fc9a0-087b-4a1b-96be-154e9fbe3cbe tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:19.403864 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-0f8fc9a0-087b-4a1b-96be-154e9fbe3cbe tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:19.535379 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-0f8fc9a0-087b-4a1b-96be-154e9fbe3cbe tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:19.542686 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-0f8fc9a0-087b-4a1b-96be-154e9fbe3cbe tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.156497 May 23 11:02:19.543247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 452/916] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:19 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:20.560863 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3171d5ec-9c0a-4723-8240-b409ebe4c368 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:20.561601 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3171d5ec-9c0a-4723-8240-b409ebe4c368 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:20.568191 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3171d5ec-9c0a-4723-8240-b409ebe4c368 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:20.568646 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3171d5ec-9c0a-4723-8240-b409ebe4c368 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:20.569425 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3171d5ec-9c0a-4723-8240-b409ebe4c368 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:20.569862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3171d5ec-9c0a-4723-8240-b409ebe4c368 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:20.711416 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3171d5ec-9c0a-4723-8240-b409ebe4c368 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:20.719288 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3171d5ec-9c0a-4723-8240-b409ebe4c368 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.163133 May 23 11:02:20.719870 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 465/917] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:20 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:21.736611 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6829ef8f-774a-47dc-b3a3-2c06eaad0ec2 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:21.737213 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6829ef8f-774a-47dc-b3a3-2c06eaad0ec2 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:21.744554 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6829ef8f-774a-47dc-b3a3-2c06eaad0ec2 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:21.745003 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6829ef8f-774a-47dc-b3a3-2c06eaad0ec2 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:21.745778 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6829ef8f-774a-47dc-b3a3-2c06eaad0ec2 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:21.746249 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6829ef8f-774a-47dc-b3a3-2c06eaad0ec2 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:21.873458 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6829ef8f-774a-47dc-b3a3-2c06eaad0ec2 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:21.881452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6829ef8f-774a-47dc-b3a3-2c06eaad0ec2 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.148655 May 23 11:02:21.882044 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 453/918] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:21 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:22.840533 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-d54fbafa-8c0f-4815-a3a7-de0c1013559c req-66a7d3b7-63c1-4b62-a6b9-d2f96d7c07bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9139f29e-ed6d-4b8c-a8f1-8b7b4899857d", "name": "network-vif-plugged", "status": "completed", "tag": "bae4a123-9d28-40c2-a622-78818f3c9569"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:22.849611 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-d54fbafa-8c0f-4815-a3a7-de0c1013559c req-66a7d3b7-63c1-4b62-a6b9-d2f96d7c07bf service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:22.850101 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-d54fbafa-8c0f-4815-a3a7-de0c1013559c req-66a7d3b7-63c1-4b62-a6b9-d2f96d7c07bf service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:22.861257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-d54fbafa-8c0f-4815-a3a7-de0c1013559c req-66a7d3b7-63c1-4b62-a6b9-d2f96d7c07bf service nova] Creating event network-vif-plugged:bae4a123-9d28-40c2-a622-78818f3c9569 for instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d on hv-cinder-83699 May 23 11:02:22.866850 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-d54fbafa-8c0f-4815-a3a7-de0c1013559c req-66a7d3b7-63c1-4b62-a6b9-d2f96d7c07bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030030 May 23 11:02:22.867602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 466/919] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:22.898387 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6324a19d-0df2-4887-be0d-817420db5fd3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:22.899000 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6324a19d-0df2-4887-be0d-817420db5fd3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:22.905870 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6324a19d-0df2-4887-be0d-817420db5fd3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:22.905870 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6324a19d-0df2-4887-be0d-817420db5fd3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:22.906683 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6324a19d-0df2-4887-be0d-817420db5fd3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:22.907115 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6324a19d-0df2-4887-be0d-817420db5fd3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:23.035513 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6324a19d-0df2-4887-be0d-817420db5fd3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:23.043054 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6324a19d-0df2-4887-be0d-817420db5fd3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.148936 May 23 11:02:23.043628 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 454/920] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:22 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:24.061522 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3798bba0-83b3-404e-a95d-71c72b2fafed tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:24.062234 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3798bba0-83b3-404e-a95d-71c72b2fafed tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:24.068448 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3798bba0-83b3-404e-a95d-71c72b2fafed tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:24.068892 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3798bba0-83b3-404e-a95d-71c72b2fafed tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:24.069651 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3798bba0-83b3-404e-a95d-71c72b2fafed tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:24.070112 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3798bba0-83b3-404e-a95d-71c72b2fafed tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:24.200648 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-3798bba0-83b3-404e-a95d-71c72b2fafed tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:24.209643 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3798bba0-83b3-404e-a95d-71c72b2fafed tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1358 microversion: 2.1 time: 0.152734 May 23 11:02:24.210238 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 467/921] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:24 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:25.226294 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8d0ba346-cc19-4f9e-8896-92f1be2f7781 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:25.226901 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8d0ba346-cc19-4f9e-8896-92f1be2f7781 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:25.233792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8d0ba346-cc19-4f9e-8896-92f1be2f7781 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:25.234263 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8d0ba346-cc19-4f9e-8896-92f1be2f7781 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:25.235059 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8d0ba346-cc19-4f9e-8896-92f1be2f7781 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:25.235541 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8d0ba346-cc19-4f9e-8896-92f1be2f7781 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:25.364006 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8d0ba346-cc19-4f9e-8896-92f1be2f7781 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:25.371375 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8d0ba346-cc19-4f9e-8896-92f1be2f7781 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1549 microversion: 2.1 time: 0.148938 May 23 11:02:25.371941 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 455/922] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:25 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:25.387581 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bbd49530-2e88-4246-95d1-cfe90ff091c9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:25.388229 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bbd49530-2e88-4246-95d1-cfe90ff091c9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:25.394740 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bbd49530-2e88-4246-95d1-cfe90ff091c9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:25.395190 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bbd49530-2e88-4246-95d1-cfe90ff091c9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:25.395955 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bbd49530-2e88-4246-95d1-cfe90ff091c9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:25.396394 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bbd49530-2e88-4246-95d1-cfe90ff091c9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:25.523933 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bbd49530-2e88-4246-95d1-cfe90ff091c9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:25.531309 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bbd49530-2e88-4246-95d1-cfe90ff091c9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1549 microversion: 2.1 time: 0.147576 May 23 11:02:25.531874 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 468/923] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:25 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:25.546578 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d8193faf-89dd-4ce9-989a-7afeabb2c68f tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:25.550673 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d8193faf-89dd-4ce9-989a-7afeabb2c68f tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:25.551431 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d8193faf-89dd-4ce9-989a-7afeabb2c68f tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Searching by: {'deleted': False, 'project_id': 'e35c886cdaaf465eacd001e132128cbd'} {{(pid=129030) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 23 11:02:25.557864 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d8193faf-89dd-4ce9-989a-7afeabb2c68f tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:25.558336 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d8193faf-89dd-4ce9-989a-7afeabb2c68f tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:25.559129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d8193faf-89dd-4ce9-989a-7afeabb2c68f tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:25.559559 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d8193faf-89dd-4ce9-989a-7afeabb2c68f tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:25.646228 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.multi_cell_list [None req-d8193faf-89dd-4ce9-989a-7afeabb2c68f tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 23 11:02:25.739716 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d8193faf-89dd-4ce9-989a-7afeabb2c68f tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.196821 May 23 11:02:25.740294 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 456/924] 10.222.0.36 () {58 vars in 1124 bytes} [Mon May 23 11:02:25 2022] GET /compute/v2.1/servers => generated 342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:25.750296 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bfeea71b-ada0-4094-82d3-75a686a2a70b tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:25.750907 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bfeea71b-ada0-4094-82d3-75a686a2a70b tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:25.756959 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfeea71b-ada0-4094-82d3-75a686a2a70b tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:25.757408 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfeea71b-ada0-4094-82d3-75a686a2a70b tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:25.758242 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfeea71b-ada0-4094-82d3-75a686a2a70b tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:25.758685 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfeea71b-ada0-4094-82d3-75a686a2a70b tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:25.885235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bfeea71b-ada0-4094-82d3-75a686a2a70b tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:25.892652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bfeea71b-ada0-4094-82d3-75a686a2a70b tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1549 microversion: 2.1 time: 0.146160 May 23 11:02:25.893215 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 469/925] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:25 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:27.391157 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8b8f6714-87a3-435d-ac30-21345a8747bd tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4bdd631-5149-4bf1-956a-ce18588239b7"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:27.392209 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8b8f6714-87a3-435d-ac30-21345a8747bd tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:27.399065 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8b8f6714-87a3-435d-ac30-21345a8747bd tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:27.399513 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8b8f6714-87a3-435d-ac30-21345a8747bd tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:27.400271 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8b8f6714-87a3-435d-ac30-21345a8747bd tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:27.400703 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8b8f6714-87a3-435d-ac30-21345a8747bd tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:27.645821 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8b8f6714-87a3-435d-ac30-21345a8747bd tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "POST /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258535 May 23 11:02:27.646544 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 457/926] 10.222.0.36 () {60 vars in 1322 bytes} [Mon May 23 11:02:27 2022] POST /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:33.871380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-eab5b759-4cee-4998-821d-8f6518f7d8b8 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:33.871989 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-eab5b759-4cee-4998-821d-8f6518f7d8b8 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:33.878352 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eab5b759-4cee-4998-821d-8f6518f7d8b8 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:33.878797 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eab5b759-4cee-4998-821d-8f6518f7d8b8 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:33.879560 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eab5b759-4cee-4998-821d-8f6518f7d8b8 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:33.879993 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-eab5b759-4cee-4998-821d-8f6518f7d8b8 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:33.907124 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-eab5b759-4cee-4998-821d-8f6518f7d8b8 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 11:02:33.980571 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-eab5b759-4cee-4998-821d-8f6518f7d8b8 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 204 len: 0 microversion: 2.1 time: 0.112728 May 23 11:02:33.981162 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 470/927] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 11:02:33 2022] DELETE /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 11:02:33.990389 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b62ae148-f488-4c78-897a-77888b3c11a9 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:33.991097 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b62ae148-f488-4c78-897a-77888b3c11a9 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:33.997671 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b62ae148-f488-4c78-897a-77888b3c11a9 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:33.998240 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b62ae148-f488-4c78-897a-77888b3c11a9 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:33.999234 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b62ae148-f488-4c78-897a-77888b3c11a9 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:33.999760 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b62ae148-f488-4c78-897a-77888b3c11a9 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:34.131392 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b62ae148-f488-4c78-897a-77888b3c11a9 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:34.141311 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b62ae148-f488-4c78-897a-77888b3c11a9 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1579 microversion: 2.1 time: 0.155665 May 23 11:02:34.143165 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 458/928] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:33 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:35.161569 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-82220d8a-a8ab-4928-b29d-000136eb95dc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:35.162282 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-82220d8a-a8ab-4928-b29d-000136eb95dc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:35.168642 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-82220d8a-a8ab-4928-b29d-000136eb95dc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:35.169082 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-82220d8a-a8ab-4928-b29d-000136eb95dc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:35.169838 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-82220d8a-a8ab-4928-b29d-000136eb95dc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:35.170320 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-82220d8a-a8ab-4928-b29d-000136eb95dc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:35.298199 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-82220d8a-a8ab-4928-b29d-000136eb95dc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:35.305651 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-82220d8a-a8ab-4928-b29d-000136eb95dc tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1579 microversion: 2.1 time: 0.148877 May 23 11:02:35.306242 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 471/929] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:35 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1579 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:36.229301 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-fa7bd1b9-9a8a-4df8-897e-c5532068617d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:36.229909 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-fa7bd1b9-9a8a-4df8-897e-c5532068617d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:36.232344 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:36.237836 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fa7bd1b9-9a8a-4df8-897e-c5532068617d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:36.238634 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fa7bd1b9-9a8a-4df8-897e-c5532068617d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:36.239138 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fa7bd1b9-9a8a-4df8-897e-c5532068617d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:36.239579 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-fa7bd1b9-9a8a-4df8-897e-c5532068617d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:36.244607 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:36.322779 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6ae07a51-e249-43ea-9228-67409dd3d411 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:36.323341 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6ae07a51-e249-43ea-9228-67409dd3d411 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:36.329925 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6ae07a51-e249-43ea-9228-67409dd3d411 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:36.330485 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6ae07a51-e249-43ea-9228-67409dd3d411 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:36.331353 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6ae07a51-e249-43ea-9228-67409dd3d411 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:36.331866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6ae07a51-e249-43ea-9228-67409dd3d411 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:36.464259 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6ae07a51-e249-43ea-9228-67409dd3d411 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:36.467843 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-fa7bd1b9-9a8a-4df8-897e-c5532068617d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:36.472040 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6ae07a51-e249-43ea-9228-67409dd3d411 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1579 microversion: 2.1 time: 0.153177 May 23 11:02:36.472820 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 472/930] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:36 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 11:02:36.476676 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-fa7bd1b9-9a8a-4df8-897e-c5532068617d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1595 microversion: 2.1 time: 0.251110 May 23 11:02:36.487535 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 459/931] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:36 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1595 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:37.044387 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-65094ea4-92e8-4baa-8b2a-8e487bdbeea1 req-d929ae05-bec1-4537-9874-16be3e428775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5249a457-7b0f-4659-8591-228ab1ea821e", "name": "network-vif-deleted", "tag": "176ef9af-c6c7-4d03-80eb-ba6a7ce97f4c"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:37.054583 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-65094ea4-92e8-4baa-8b2a-8e487bdbeea1 req-d929ae05-bec1-4537-9874-16be3e428775 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:37.055307 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-65094ea4-92e8-4baa-8b2a-8e487bdbeea1 req-d929ae05-bec1-4537-9874-16be3e428775 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:37.068491 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-65094ea4-92e8-4baa-8b2a-8e487bdbeea1 req-d929ae05-bec1-4537-9874-16be3e428775 service nova] Creating event network-vif-deleted:176ef9af-c6c7-4d03-80eb-ba6a7ce97f4c for instance 5249a457-7b0f-4659-8591-228ab1ea821e on hv-cinder-83699 May 23 11:02:37.079229 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-65094ea4-92e8-4baa-8b2a-8e487bdbeea1 req-d929ae05-bec1-4537-9874-16be3e428775 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038305 May 23 11:02:37.082511 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 473/932] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:37.490025 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:37.490778 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:37.497857 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:37.498497 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:37.500068 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:37.501058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:37.549129 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:37.549987 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:37.550664 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lazy-loading 'fault' on Instance uuid 5249a457-7b0f-4659-8591-228ab1ea821e {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 11:02:37.602619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:37.610253 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8436485d-0da4-4a93-ac32-f4ce74c1e203 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 200 len: 1231 microversion: 2.1 time: 0.124907 May 23 11:02:37.610919 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 460/933] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:37 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 1231 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:38.486385 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-ec901c74-b841-4752-a305-e684cee2a973 req-48f6081c-7b1d-4fc5-9826-ab51a6c9e8dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9139f29e-ed6d-4b8c-a8f1-8b7b4899857d", "tag": "bae4a123-9d28-40c2-a622-78818f3c9569"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:38.490556 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:38.497473 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-ec901c74-b841-4752-a305-e684cee2a973 req-48f6081c-7b1d-4fc5-9826-ab51a6c9e8dd service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:38.498257 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-ec901c74-b841-4752-a305-e684cee2a973 req-48f6081c-7b1d-4fc5-9826-ab51a6c9e8dd service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:38.511152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-ec901c74-b841-4752-a305-e684cee2a973 req-48f6081c-7b1d-4fc5-9826-ab51a6c9e8dd service nova] Creating event network-changed:bae4a123-9d28-40c2-a622-78818f3c9569 for instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d on hv-cinder-83699 May 23 11:02:38.516415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-ec901c74-b841-4752-a305-e684cee2a973 req-48f6081c-7b1d-4fc5-9826-ab51a6c9e8dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033968 May 23 11:02:38.517440 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 474/934] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:38.629015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9f638129-db59-4c2e-a1fb-3530003f00f2 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:38.630986 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9f638129-db59-4c2e-a1fb-3530003f00f2 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:38.635185 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:38.640148 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9f638129-db59-4c2e-a1fb-3530003f00f2 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:38.640536 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9f638129-db59-4c2e-a1fb-3530003f00f2 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:38.641317 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9f638129-db59-4c2e-a1fb-3530003f00f2 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:38.641841 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9f638129-db59-4c2e-a1fb-3530003f00f2 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:38.659765 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-9f638129-db59-4c2e-a1fb-3530003f00f2 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] HTTP exception thrown: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9f638129-db59-4c2e-a1fb-3530003f00f2 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Request method failure captured: May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e HTTP/1.1 May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2kd9hEhh57Ok7jJSd7dcWGrkG5MpuYoNBJVjug8jjqcnsUUHQT2f7kNdX2T95nGyw6W4bde8DtZRaPob4oVV0_vWpOfdYESpRGRtJyB1B4jkw8wNmiloOTTpOtsJYgdW55tZte2eIBbKfHZdYqNMef3QIByVfFxDq1Bihnzx2_Q_XI May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 86e332b470c841db8d7d852c1c0a4a26 May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-TestVolumeBootPattern-1896703949 May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 11:02:38.662269 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e332b470c841db8d7d852c1c0a4a26", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-TestVolumeBootPattern-1896703949 May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 86e332b470c841db8d7d852c1c0a4a26 May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-TestVolumeBootPattern-1896703949 May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-TestVolumeBootPattern-1896703949-project May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 5b53f05946e34f9f8395526212c5b17f May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-TestVolumeBootPattern-1896703949-project May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:02:38.664015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': '5249a457-7b0f-4659-8591-228ab1ea821e'} May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 11:02:38.665017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:02:38.667202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:02:38.670767 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9f638129-db59-4c2e-a1fb-3530003f00f2 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Returning 404 to user: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 11:02:38.672317 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9f638129-db59-4c2e-a1fb-3530003f00f2 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 404 len: 111 microversion: 2.1 time: 0.047427 May 23 11:02:38.673462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 461/935] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:38 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 11:02:38.861986 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1389573319", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1840680101", "security_groups": [{"name": "tempest-secgroup-smoke-595907096"}], "block_device_mapping_v2": [{"uuid": "129b7f94-7863-4971-9448-501821935569", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b814bad-a4b2-460e-a94c-57193f7a8608"}]}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:39.015818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.network.neutron [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] validate_networks() for [('3b814bad-a4b2-460e-a94c-57193f7a8608', None, None, None, None, None)] {{(pid=129029) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 11:02:39.441576 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Flavor limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 11:02:39.442075 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Image limits 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 11:02:39.442552 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Flavor pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 11:02:39.442962 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Image pref 0:0:0 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 11:02:39.443392 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.virt.hardware [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 11:02:39.453063 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:39.453514 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:39.454411 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:39.455239 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:39.472566 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Getting quotas for project 86e332b470c841db8d7d852c1c0a4a26. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 11:02:39.477215 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.quota [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Getting quotas for user 5b53f05946e34f9f8395526212c5b17f and project 86e332b470c841db8d7d852c1c0a4a26. Resources: {'instances', 'cores', 'ram'} {{(pid=129029) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 11:02:39.555284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Going to run 1 instances... {{(pid=129029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 11:02:39.557482 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='129b7f94-7863-4971-9448-501821935569',volume_size=None,volume_type=None)] {{(pid=129029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 11:02:39.689682 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e19eafbb-4cbd-43ac-9add-4e2fcf3160fa tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1637974551"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:39.690699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e19eafbb-4cbd-43ac-9add-4e2fcf3160fa tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:39.697373 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e19eafbb-4cbd-43ac-9add-4e2fcf3160fa tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:39.697820 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e19eafbb-4cbd-43ac-9add-4e2fcf3160fa tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:39.698620 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e19eafbb-4cbd-43ac-9add-4e2fcf3160fa tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:39.699052 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e19eafbb-4cbd-43ac-9add-4e2fcf3160fa tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:39.712668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-43dbc19d-2172-4a94-b864-d0877d739399 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.855488 May 23 11:02:39.713551 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 475/936] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 11:02:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 11:02:39.725762 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-47cf05bc-caee-4b35-a5a4-ff3185fb33ab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:39.726454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-47cf05bc-caee-4b35-a5a4-ff3185fb33ab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:39.790452 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-47cf05bc-caee-4b35-a5a4-ff3185fb33ab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:39.797809 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-47cf05bc-caee-4b35-a5a4-ff3185fb33ab tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1095 microversion: 2.1 time: 0.077320 May 23 11:02:39.799003 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 476/937] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:39 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:39.865413 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.network.security_group_api [None req-e19eafbb-4cbd-43ac-9add-4e2fcf3160fa tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Adding security group 39f095c8-db44-462e-a64b-d30e2cf67878 to port bae4a123-9d28-40c2-a622-78818f3c9569 May 23 11:02:40.251832 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e19eafbb-4cbd-43ac-9add-4e2fcf3160fa tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "POST /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/action" status: 202 len: 0 microversion: 2.1 time: 0.565856 May 23 11:02:40.253294 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 462/938] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 11:02:39 2022] POST /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:02:40.262741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-491f1d59-d389-41f7-b72a-ef6839825ca6 req-e183e8c9-dfb9-404d-9908-68f441e73742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9139f29e-ed6d-4b8c-a8f1-8b7b4899857d", "tag": "bae4a123-9d28-40c2-a622-78818f3c9569"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:40.265066 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-78559797-c500-4e7a-b444-55f4d97af9b5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:40.267854 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-78559797-c500-4e7a-b444-55f4d97af9b5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:40.272683 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-491f1d59-d389-41f7-b72a-ef6839825ca6 req-e183e8c9-dfb9-404d-9908-68f441e73742 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:40.273574 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-491f1d59-d389-41f7-b72a-ef6839825ca6 req-e183e8c9-dfb9-404d-9908-68f441e73742 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:40.286554 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-78559797-c500-4e7a-b444-55f4d97af9b5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:40.291292 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-491f1d59-d389-41f7-b72a-ef6839825ca6 req-e183e8c9-dfb9-404d-9908-68f441e73742 service nova] Creating event network-changed:bae4a123-9d28-40c2-a622-78818f3c9569 for instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d on hv-cinder-83699 May 23 11:02:40.297569 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-78559797-c500-4e7a-b444-55f4d97af9b5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:40.298076 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-491f1d59-d389-41f7-b72a-ef6839825ca6 req-e183e8c9-dfb9-404d-9908-68f441e73742 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038573 May 23 11:02:40.298819 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-78559797-c500-4e7a-b444-55f4d97af9b5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:40.299285 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 463/939] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:40.300264 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-78559797-c500-4e7a-b444-55f4d97af9b5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:40.308700 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:40.498803 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-78559797-c500-4e7a-b444-55f4d97af9b5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:40.508069 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-78559797-c500-4e7a-b444-55f4d97af9b5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1761 microversion: 2.1 time: 0.248771 May 23 11:02:40.508645 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 477/940] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:40 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1761 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:40.816086 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b193e8a0-a086-4618-9941-495bd8dc5fcb tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:40.817854 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b193e8a0-a086-4618-9941-495bd8dc5fcb tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:40.825190 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b193e8a0-a086-4618-9941-495bd8dc5fcb tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:40.825979 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b193e8a0-a086-4618-9941-495bd8dc5fcb tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:40.826823 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b193e8a0-a086-4618-9941-495bd8dc5fcb tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:40.827376 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b193e8a0-a086-4618-9941-495bd8dc5fcb tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:40.959390 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b193e8a0-a086-4618-9941-495bd8dc5fcb tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:40.974841 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b193e8a0-a086-4618-9941-495bd8dc5fcb tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1201 microversion: 2.1 time: 0.162154 May 23 11:02:40.987083 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 464/941] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:40 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1201 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:41.993638 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f86aaf9e-d8b3-4096-bfb2-fdf0682b2696 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:41.994532 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f86aaf9e-d8b3-4096-bfb2-fdf0682b2696 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:42.000967 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f86aaf9e-d8b3-4096-bfb2-fdf0682b2696 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:42.001421 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f86aaf9e-d8b3-4096-bfb2-fdf0682b2696 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:42.002226 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f86aaf9e-d8b3-4096-bfb2-fdf0682b2696 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:42.002666 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f86aaf9e-d8b3-4096-bfb2-fdf0682b2696 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:42.136057 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f86aaf9e-d8b3-4096-bfb2-fdf0682b2696 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:42.143641 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f86aaf9e-d8b3-4096-bfb2-fdf0682b2696 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.153774 May 23 11:02:42.144127 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 478/942] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:41 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:42.494360 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-b734c470-89dc-42d3-9b31-e2a9d0bdddf3 req-2baf27d3-6b97-4046-817b-995aed664a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99d04eb-deeb-4c4b-9180-d2b156951af3", "tag": "b512d93e-0bdc-454d-9cf4-6782b1419a9e"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:42.503962 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-b734c470-89dc-42d3-9b31-e2a9d0bdddf3 req-2baf27d3-6b97-4046-817b-995aed664a7a service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:42.504514 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-b734c470-89dc-42d3-9b31-e2a9d0bdddf3 req-2baf27d3-6b97-4046-817b-995aed664a7a service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:42.524267 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-b734c470-89dc-42d3-9b31-e2a9d0bdddf3 req-2baf27d3-6b97-4046-817b-995aed664a7a service nova] Creating event network-changed:b512d93e-0bdc-454d-9cf4-6782b1419a9e for instance b99d04eb-deeb-4c4b-9180-d2b156951af3 on hv-cinder-83699 May 23 11:02:42.529392 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-b734c470-89dc-42d3-9b31-e2a9d0bdddf3 req-2baf27d3-6b97-4046-817b-995aed664a7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041497 May 23 11:02:42.529969 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 465/943] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:43.160558 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f115ecd2-b60a-4e88-8cc8-87ec91fd6228 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:43.161174 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f115ecd2-b60a-4e88-8cc8-87ec91fd6228 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:43.167638 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f115ecd2-b60a-4e88-8cc8-87ec91fd6228 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:43.168088 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f115ecd2-b60a-4e88-8cc8-87ec91fd6228 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:43.168852 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f115ecd2-b60a-4e88-8cc8-87ec91fd6228 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:43.169291 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f115ecd2-b60a-4e88-8cc8-87ec91fd6228 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:43.299230 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f115ecd2-b60a-4e88-8cc8-87ec91fd6228 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:43.307560 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f115ecd2-b60a-4e88-8cc8-87ec91fd6228 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.150713 May 23 11:02:43.308147 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 479/944] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:43 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:44.325396 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-c9649c99-5a2e-4127-a1d3-ae98aee6a788 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:44.326126 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-c9649c99-5a2e-4127-a1d3-ae98aee6a788 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:44.332333 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c9649c99-5a2e-4127-a1d3-ae98aee6a788 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:44.333289 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c9649c99-5a2e-4127-a1d3-ae98aee6a788 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:44.334081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c9649c99-5a2e-4127-a1d3-ae98aee6a788 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:44.334518 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-c9649c99-5a2e-4127-a1d3-ae98aee6a788 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:44.465867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-c9649c99-5a2e-4127-a1d3-ae98aee6a788 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:44.473289 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-c9649c99-5a2e-4127-a1d3-ae98aee6a788 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.152625 May 23 11:02:44.473859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 466/945] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:44 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:45.490148 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6fb5be9d-62d3-4dae-ac13-64b8b5a24a1d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:45.490824 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6fb5be9d-62d3-4dae-ac13-64b8b5a24a1d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:45.497317 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6fb5be9d-62d3-4dae-ac13-64b8b5a24a1d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:45.497773 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6fb5be9d-62d3-4dae-ac13-64b8b5a24a1d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:45.498585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6fb5be9d-62d3-4dae-ac13-64b8b5a24a1d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:45.499029 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6fb5be9d-62d3-4dae-ac13-64b8b5a24a1d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:45.630544 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6fb5be9d-62d3-4dae-ac13-64b8b5a24a1d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:45.638077 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6fb5be9d-62d3-4dae-ac13-64b8b5a24a1d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.151771 May 23 11:02:45.638650 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 480/946] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:45 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:46.654816 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-71567b01-0386-4d58-8656-8b079f6147f0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:46.655426 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-71567b01-0386-4d58-8656-8b079f6147f0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:46.662500 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-71567b01-0386-4d58-8656-8b079f6147f0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:46.662947 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-71567b01-0386-4d58-8656-8b079f6147f0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:46.663711 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-71567b01-0386-4d58-8656-8b079f6147f0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:46.664147 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-71567b01-0386-4d58-8656-8b079f6147f0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:46.790977 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-71567b01-0386-4d58-8656-8b079f6147f0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:46.798383 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-71567b01-0386-4d58-8656-8b079f6147f0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.147331 May 23 11:02:46.798956 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 467/947] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:46 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:47.815091 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9f3e0574-f5fa-4c06-9528-ced12d6f0075 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:47.815706 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9f3e0574-f5fa-4c06-9528-ced12d6f0075 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:47.822652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f3e0574-f5fa-4c06-9528-ced12d6f0075 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:47.823102 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f3e0574-f5fa-4c06-9528-ced12d6f0075 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:47.823908 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f3e0574-f5fa-4c06-9528-ced12d6f0075 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:47.824346 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9f3e0574-f5fa-4c06-9528-ced12d6f0075 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:47.950865 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9f3e0574-f5fa-4c06-9528-ced12d6f0075 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:47.958826 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9f3e0574-f5fa-4c06-9528-ced12d6f0075 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.147570 May 23 11:02:47.959424 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 481/948] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:47 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:48.975412 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-f22cc5e3-30a6-45ae-bf4a-77c1927a22a3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:48.976037 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-f22cc5e3-30a6-45ae-bf4a-77c1927a22a3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:48.982548 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f22cc5e3-30a6-45ae-bf4a-77c1927a22a3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:48.982987 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f22cc5e3-30a6-45ae-bf4a-77c1927a22a3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:48.983744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f22cc5e3-30a6-45ae-bf4a-77c1927a22a3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:48.984174 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-f22cc5e3-30a6-45ae-bf4a-77c1927a22a3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:49.111883 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-f22cc5e3-30a6-45ae-bf4a-77c1927a22a3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:49.119330 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-f22cc5e3-30a6-45ae-bf4a-77c1927a22a3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.147820 May 23 11:02:49.119901 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 468/949] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:48 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:50.136063 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c8c8cd8f-2de4-4f63-87e9-195b0804fb10 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:50.136674 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c8c8cd8f-2de4-4f63-87e9-195b0804fb10 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:50.139018 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=2 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:50.139708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=8 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:02:50.146645 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c8c8cd8f-2de4-4f63-87e9-195b0804fb10 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:50.147103 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c8c8cd8f-2de4-4f63-87e9-195b0804fb10 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:50.147875 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c8c8cd8f-2de4-4f63-87e9-195b0804fb10 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:50.148568 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-c8c8cd8f-2de4-4f63-87e9-195b0804fb10 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:50.281696 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c8c8cd8f-2de4-4f63-87e9-195b0804fb10 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:50.289811 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c8c8cd8f-2de4-4f63-87e9-195b0804fb10 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.157632 May 23 11:02:50.290414 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 482/950] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:50 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:51.306633 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-d0e479ec-7071-4ec7-869a-0974f8a1a6b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:51.307350 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-d0e479ec-7071-4ec7-869a-0974f8a1a6b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:51.314355 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0e479ec-7071-4ec7-869a-0974f8a1a6b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:51.314759 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0e479ec-7071-4ec7-869a-0974f8a1a6b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:51.315553 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0e479ec-7071-4ec7-869a-0974f8a1a6b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:51.315996 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-d0e479ec-7071-4ec7-869a-0974f8a1a6b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:51.453728 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-d0e479ec-7071-4ec7-869a-0974f8a1a6b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:51.461833 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-d0e479ec-7071-4ec7-869a-0974f8a1a6b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.159105 May 23 11:02:51.462454 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 469/951] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:51 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:52.479181 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-9951d1e6-5e21-465b-b2fa-c69d503aafe6 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:52.479711 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-9951d1e6-5e21-465b-b2fa-c69d503aafe6 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:52.486259 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9951d1e6-5e21-465b-b2fa-c69d503aafe6 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:52.486704 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9951d1e6-5e21-465b-b2fa-c69d503aafe6 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:52.487456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9951d1e6-5e21-465b-b2fa-c69d503aafe6 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:52.487906 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-9951d1e6-5e21-465b-b2fa-c69d503aafe6 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:52.615176 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-9951d1e6-5e21-465b-b2fa-c69d503aafe6 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:52.622682 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-9951d1e6-5e21-465b-b2fa-c69d503aafe6 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.147454 May 23 11:02:52.623246 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 483/952] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:52 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:52.904637 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-3dfc26f4-9569-43de-960b-9d4edcae5c54 req-eb0522fc-460a-40e3-9815-7212ad9a6902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99d04eb-deeb-4c4b-9180-d2b156951af3", "name": "network-vif-plugged", "status": "completed", "tag": "b512d93e-0bdc-454d-9cf4-6782b1419a9e"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:52.913035 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-3dfc26f4-9569-43de-960b-9d4edcae5c54 req-eb0522fc-460a-40e3-9815-7212ad9a6902 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:52.913495 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-3dfc26f4-9569-43de-960b-9d4edcae5c54 req-eb0522fc-460a-40e3-9815-7212ad9a6902 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:52.924380 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-3dfc26f4-9569-43de-960b-9d4edcae5c54 req-eb0522fc-460a-40e3-9815-7212ad9a6902 service nova] Creating event network-vif-plugged:b512d93e-0bdc-454d-9cf4-6782b1419a9e for instance b99d04eb-deeb-4c4b-9180-d2b156951af3 on hv-cinder-83699 May 23 11:02:52.929272 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-3dfc26f4-9569-43de-960b-9d4edcae5c54 req-eb0522fc-460a-40e3-9815-7212ad9a6902 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028367 May 23 11:02:52.929859 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 470/953] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:02:53.639973 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d9f00a19-e9d0-401f-b4a6-34f8c75cfba5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:53.640518 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d9f00a19-e9d0-401f-b4a6-34f8c75cfba5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:53.647233 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d9f00a19-e9d0-401f-b4a6-34f8c75cfba5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:53.647694 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d9f00a19-e9d0-401f-b4a6-34f8c75cfba5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:53.648729 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d9f00a19-e9d0-401f-b4a6-34f8c75cfba5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:53.649170 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d9f00a19-e9d0-401f-b4a6-34f8c75cfba5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:53.779057 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d9f00a19-e9d0-401f-b4a6-34f8c75cfba5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:53.787155 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d9f00a19-e9d0-401f-b4a6-34f8c75cfba5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1266 microversion: 2.1 time: 0.150515 May 23 11:02:53.787719 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 484/954] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:53 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:54.805184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-61612193-c979-4eea-b812-4c9580506432 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:54.805969 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-61612193-c979-4eea-b812-4c9580506432 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:54.812184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-61612193-c979-4eea-b812-4c9580506432 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:54.812634 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-61612193-c979-4eea-b812-4c9580506432 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:54.813398 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-61612193-c979-4eea-b812-4c9580506432 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:54.813836 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-61612193-c979-4eea-b812-4c9580506432 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:54.948061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-61612193-c979-4eea-b812-4c9580506432 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:54.955630 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-61612193-c979-4eea-b812-4c9580506432 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1453 microversion: 2.1 time: 0.155281 May 23 11:02:54.956219 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 471/955] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:54 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:54.972256 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-cbf7c34a-8a28-4e53-8bb3-f065dec35f39 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:02:54.972887 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-cbf7c34a-8a28-4e53-8bb3-f065dec35f39 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:02:54.979379 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cbf7c34a-8a28-4e53-8bb3-f065dec35f39 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:54.979828 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cbf7c34a-8a28-4e53-8bb3-f065dec35f39 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:54.980589 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cbf7c34a-8a28-4e53-8bb3-f065dec35f39 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:54.981024 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-cbf7c34a-8a28-4e53-8bb3-f065dec35f39 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:55.111345 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-cbf7c34a-8a28-4e53-8bb3-f065dec35f39 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:02:55.119395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-cbf7c34a-8a28-4e53-8bb3-f065dec35f39 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1453 microversion: 2.1 time: 0.151117 May 23 11:02:55.119955 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 485/956] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:02:54 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:02:56.695626 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-4498e975-0273-48f4-b125-f6ef3660fa22 req-2070517f-3b34-40fc-b4ab-3aeab0629bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99d04eb-deeb-4c4b-9180-d2b156951af3", "tag": "b512d93e-0bdc-454d-9cf4-6782b1419a9e"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:02:56.704363 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-4498e975-0273-48f4-b125-f6ef3660fa22 req-2070517f-3b34-40fc-b4ab-3aeab0629bf4 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:02:56.704808 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-4498e975-0273-48f4-b125-f6ef3660fa22 req-2070517f-3b34-40fc-b4ab-3aeab0629bf4 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:02:56.716673 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-4498e975-0273-48f4-b125-f6ef3660fa22 req-2070517f-3b34-40fc-b4ab-3aeab0629bf4 service nova] Creating event network-changed:b512d93e-0bdc-454d-9cf4-6782b1419a9e for instance b99d04eb-deeb-4c4b-9180-d2b156951af3 on hv-cinder-83699 May 23 11:02:56.722020 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-4498e975-0273-48f4-b125-f6ef3660fa22 req-2070517f-3b34-40fc-b4ab-3aeab0629bf4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029948 May 23 11:02:56.722664 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 472/957] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:03:02.870825 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d799a8de-b19d-420f-9cd0-3479bfd50898 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:03:02.871851 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d799a8de-b19d-420f-9cd0-3479bfd50898 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:02.878284 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d799a8de-b19d-420f-9cd0-3479bfd50898 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:02.878733 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d799a8de-b19d-420f-9cd0-3479bfd50898 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:02.879496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d799a8de-b19d-420f-9cd0-3479bfd50898 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:02.879930 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d799a8de-b19d-420f-9cd0-3479bfd50898 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:02.950306 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d799a8de-b19d-420f-9cd0-3479bfd50898 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "POST /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/action" status: 202 len: 0 microversion: 2.1 time: 0.083158 May 23 11:03:02.951108 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 486/958] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 11:03:02 2022] POST /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:03:02.962198 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-8eab7e60-9d1c-4752-a7d6-cc8082ef2184 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:02.962976 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-8eab7e60-9d1c-4752-a7d6-cc8082ef2184 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:02.970669 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8eab7e60-9d1c-4752-a7d6-cc8082ef2184 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:02.971113 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8eab7e60-9d1c-4752-a7d6-cc8082ef2184 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:02.972069 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8eab7e60-9d1c-4752-a7d6-cc8082ef2184 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:02.972506 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-8eab7e60-9d1c-4752-a7d6-cc8082ef2184 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:03.211877 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-8eab7e60-9d1c-4752-a7d6-cc8082ef2184 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:03.219835 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-8eab7e60-9d1c-4752-a7d6-cc8082ef2184 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1753 microversion: 2.1 time: 0.262869 May 23 11:03:03.220421 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 473/959] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:02 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1753 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 11:03:04.238054 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-01183c87-e647-4ce3-bafd-ef704bf77a71 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:04.238671 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-01183c87-e647-4ce3-bafd-ef704bf77a71 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:04.245405 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-01183c87-e647-4ce3-bafd-ef704bf77a71 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:04.245855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-01183c87-e647-4ce3-bafd-ef704bf77a71 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:04.246652 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-01183c87-e647-4ce3-bafd-ef704bf77a71 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:04.247089 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-01183c87-e647-4ce3-bafd-ef704bf77a71 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:04.385675 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-01183c87-e647-4ce3-bafd-ef704bf77a71 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:04.393656 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-01183c87-e647-4ce3-bafd-ef704bf77a71 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1758 microversion: 2.1 time: 0.159957 May 23 11:03:04.394259 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 487/960] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:04 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:05.411279 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-417370e9-fa90-4680-ac8a-e3c48b00ffd7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:05.411895 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-417370e9-fa90-4680-ac8a-e3c48b00ffd7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:05.418920 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-417370e9-fa90-4680-ac8a-e3c48b00ffd7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:05.419370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-417370e9-fa90-4680-ac8a-e3c48b00ffd7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:05.420139 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-417370e9-fa90-4680-ac8a-e3c48b00ffd7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:05.420574 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-417370e9-fa90-4680-ac8a-e3c48b00ffd7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:05.560318 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-417370e9-fa90-4680-ac8a-e3c48b00ffd7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:05.568161 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-417370e9-fa90-4680-ac8a-e3c48b00ffd7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1758 microversion: 2.1 time: 0.160737 May 23 11:03:05.568727 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 474/961] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:05 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:06.585497 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-b02d7f22-18b4-4353-9509-873f02e138a7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:06.586139 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-b02d7f22-18b4-4353-9509-873f02e138a7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:06.592711 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b02d7f22-18b4-4353-9509-873f02e138a7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:06.593152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b02d7f22-18b4-4353-9509-873f02e138a7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:06.593934 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b02d7f22-18b4-4353-9509-873f02e138a7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:06.594461 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-b02d7f22-18b4-4353-9509-873f02e138a7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:06.739201 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-b02d7f22-18b4-4353-9509-873f02e138a7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:06.747171 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-b02d7f22-18b4-4353-9509-873f02e138a7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1758 microversion: 2.1 time: 0.165969 May 23 11:03:06.747734 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 488/962] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:06 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:07.764119 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b07cd58e-b7af-42bd-ac70-c6c3f1125ad7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:07.764658 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b07cd58e-b7af-42bd-ac70-c6c3f1125ad7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:07.771364 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b07cd58e-b7af-42bd-ac70-c6c3f1125ad7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:07.771844 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b07cd58e-b7af-42bd-ac70-c6c3f1125ad7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:07.772633 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b07cd58e-b7af-42bd-ac70-c6c3f1125ad7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:07.773068 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b07cd58e-b7af-42bd-ac70-c6c3f1125ad7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:07.776008 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=76 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:07.916263 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b07cd58e-b7af-42bd-ac70-c6c3f1125ad7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:07.924231 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b07cd58e-b7af-42bd-ac70-c6c3f1125ad7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1758 microversion: 2.1 time: 0.163962 May 23 11:03:07.924807 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 475/963] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:07 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:08.941702 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bcb44dd6-bc24-4393-8186-a264adf4be3c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:08.942324 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bcb44dd6-bc24-4393-8186-a264adf4be3c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:08.944739 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:08.949996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bcb44dd6-bc24-4393-8186-a264adf4be3c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:08.950454 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bcb44dd6-bc24-4393-8186-a264adf4be3c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:08.951230 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bcb44dd6-bc24-4393-8186-a264adf4be3c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:08.951677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bcb44dd6-bc24-4393-8186-a264adf4be3c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:09.092265 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bcb44dd6-bc24-4393-8186-a264adf4be3c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:09.100821 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bcb44dd6-bc24-4393-8186-a264adf4be3c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1758 microversion: 2.1 time: 0.162459 May 23 11:03:09.101394 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 489/964] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:08 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:10.118578 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-6e4fccec-3457-4016-b750-2c03fea05f31 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:10.119204 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-6e4fccec-3457-4016-b750-2c03fea05f31 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:10.121453 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=30 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:10.127121 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6e4fccec-3457-4016-b750-2c03fea05f31 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:10.127576 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6e4fccec-3457-4016-b750-2c03fea05f31 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:10.128348 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6e4fccec-3457-4016-b750-2c03fea05f31 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:10.128784 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-6e4fccec-3457-4016-b750-2c03fea05f31 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:10.265771 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-6e4fccec-3457-4016-b750-2c03fea05f31 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:10.274565 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-6e4fccec-3457-4016-b750-2c03fea05f31 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1758 microversion: 2.1 time: 0.160485 May 23 11:03:10.275136 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 476/965] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:10 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:11.291162 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bb134b80-0960-4129-95e7-de0f207338a9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:11.291768 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bb134b80-0960-4129-95e7-de0f207338a9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:11.298395 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bb134b80-0960-4129-95e7-de0f207338a9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:11.298840 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bb134b80-0960-4129-95e7-de0f207338a9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:11.299592 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bb134b80-0960-4129-95e7-de0f207338a9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:11.300024 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bb134b80-0960-4129-95e7-de0f207338a9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:11.302541 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:11.446885 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bb134b80-0960-4129-95e7-de0f207338a9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:11.454934 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bb134b80-0960-4129-95e7-de0f207338a9 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1758 microversion: 2.1 time: 0.167594 May 23 11:03:11.455509 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 490/966] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:11 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:12.472079 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-903f8d3b-0041-45ea-ac61-73685c45f24a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:12.472601 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-903f8d3b-0041-45ea-ac61-73685c45f24a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:12.479708 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-903f8d3b-0041-45ea-ac61-73685c45f24a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:12.480162 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-903f8d3b-0041-45ea-ac61-73685c45f24a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:12.480932 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-903f8d3b-0041-45ea-ac61-73685c45f24a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:12.481541 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-903f8d3b-0041-45ea-ac61-73685c45f24a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:12.620968 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-903f8d3b-0041-45ea-ac61-73685c45f24a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:12.628891 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-903f8d3b-0041-45ea-ac61-73685c45f24a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1758 microversion: 2.1 time: 0.160773 May 23 11:03:12.629462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 477/967] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:12 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:13.645822 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-442f94e1-e3be-43fc-982a-43344a229ee7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:13.646480 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-442f94e1-e3be-43fc-982a-43344a229ee7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:13.653349 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-442f94e1-e3be-43fc-982a-43344a229ee7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:13.653796 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-442f94e1-e3be-43fc-982a-43344a229ee7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:13.654590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-442f94e1-e3be-43fc-982a-43344a229ee7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:13.655023 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-442f94e1-e3be-43fc-982a-43344a229ee7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:13.796826 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-442f94e1-e3be-43fc-982a-43344a229ee7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:13.805406 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-442f94e1-e3be-43fc-982a-43344a229ee7 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1758 microversion: 2.1 time: 0.163415 May 23 11:03:13.805996 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 491/968] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:13 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:14.822599 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2881d251-3b5d-4d89-8951-147559de9582 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:14.823189 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2881d251-3b5d-4d89-8951-147559de9582 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:14.829698 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2881d251-3b5d-4d89-8951-147559de9582 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:14.830186 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2881d251-3b5d-4d89-8951-147559de9582 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:14.830955 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2881d251-3b5d-4d89-8951-147559de9582 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:14.831391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2881d251-3b5d-4d89-8951-147559de9582 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:14.975156 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2881d251-3b5d-4d89-8951-147559de9582 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:14.983155 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2881d251-3b5d-4d89-8951-147559de9582 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1758 microversion: 2.1 time: 0.165090 May 23 11:03:14.983740 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 478/969] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:14 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:16.000875 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-65d4a6b1-b569-4910-bdbf-a6e79b29fa7d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:16.001539 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-65d4a6b1-b569-4910-bdbf-a6e79b29fa7d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:16.008164 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-65d4a6b1-b569-4910-bdbf-a6e79b29fa7d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:16.008618 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-65d4a6b1-b569-4910-bdbf-a6e79b29fa7d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:16.009422 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-65d4a6b1-b569-4910-bdbf-a6e79b29fa7d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:16.009861 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-65d4a6b1-b569-4910-bdbf-a6e79b29fa7d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:16.149308 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-65d4a6b1-b569-4910-bdbf-a6e79b29fa7d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:16.157199 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-65d4a6b1-b569-4910-bdbf-a6e79b29fa7d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1761 microversion: 2.1 time: 0.160205 May 23 11:03:16.157769 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 492/970] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:15 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1761 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:29.171920 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e6fa9977-6a5d-4a5c-a26e-2de45830a8de tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:29.172545 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e6fa9977-6a5d-4a5c-a26e-2de45830a8de tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:29.174117 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-83f5705b-d9fd-4298-bc20-a28b466ccae6 req-1e76867c-f19e-428d-b0f7-4800ac69b2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b27c20-a6cd-4dd3-9506-1d132be6e635", "tag": "28a6a33f-244e-40a2-b8a1-14db1a5fb3ba"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:03:29.174672 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=5 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:29.175534 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=23 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:29.179929 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=7 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:29.180699 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=17 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:29.181788 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e6fa9977-6a5d-4a5c-a26e-2de45830a8de tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:29.182733 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e6fa9977-6a5d-4a5c-a26e-2de45830a8de tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:29.183356 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e6fa9977-6a5d-4a5c-a26e-2de45830a8de tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:29.183796 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e6fa9977-6a5d-4a5c-a26e-2de45830a8de tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:29.185483 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-83f5705b-d9fd-4298-bc20-a28b466ccae6 req-1e76867c-f19e-428d-b0f7-4800ac69b2a6 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:29.185936 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-83f5705b-d9fd-4298-bc20-a28b466ccae6 req-1e76867c-f19e-428d-b0f7-4800ac69b2a6 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:29.199325 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-83f5705b-d9fd-4298-bc20-a28b466ccae6 req-1e76867c-f19e-428d-b0f7-4800ac69b2a6 service nova] Creating event network-changed:28a6a33f-244e-40a2-b8a1-14db1a5fb3ba for instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 on hv-cinder-83699 May 23 11:03:29.204487 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-83f5705b-d9fd-4298-bc20-a28b466ccae6 req-1e76867c-f19e-428d-b0f7-4800ac69b2a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034087 May 23 11:03:29.205389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 493/971] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:03:29.211510 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e6fa9977-6a5d-4a5c-a26e-2de45830a8de tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Going to try to terminate instance {{(pid=129030) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 11:03:29.292536 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e6fa9977-6a5d-4a5c-a26e-2de45830a8de tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "DELETE /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 204 len: 0 microversion: 2.1 time: 0.124756 May 23 11:03:29.293382 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 479/972] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 11:03:29 2022] DELETE /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 11:03:29.302465 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-701d4b45-cae5-4199-aa0f-c13653d255a1 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:29.303336 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-701d4b45-cae5-4199-aa0f-c13653d255a1 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:29.309826 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-701d4b45-cae5-4199-aa0f-c13653d255a1 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:29.310435 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-701d4b45-cae5-4199-aa0f-c13653d255a1 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:29.311677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-701d4b45-cae5-4199-aa0f-c13653d255a1 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:29.311677 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-701d4b45-cae5-4199-aa0f-c13653d255a1 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:29.448314 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-701d4b45-cae5-4199-aa0f-c13653d255a1 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:29.455829 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-701d4b45-cae5-4199-aa0f-c13653d255a1 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.157957 May 23 11:03:29.456401 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 494/973] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:29 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:30.474449 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2f5450ab-d542-4305-bcc1-210ed6a2d2f2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:30.475071 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2f5450ab-d542-4305-bcc1-210ed6a2d2f2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:30.482247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2f5450ab-d542-4305-bcc1-210ed6a2d2f2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:30.482695 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2f5450ab-d542-4305-bcc1-210ed6a2d2f2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:30.483455 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2f5450ab-d542-4305-bcc1-210ed6a2d2f2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:30.483886 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2f5450ab-d542-4305-bcc1-210ed6a2d2f2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:30.683760 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2f5450ab-d542-4305-bcc1-210ed6a2d2f2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:30.691211 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2f5450ab-d542-4305-bcc1-210ed6a2d2f2 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1569 microversion: 2.1 time: 0.221148 May 23 11:03:30.691778 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 480/974] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:30 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:31.708984 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-80d334ac-8567-44f4-878e-c03b56102f0a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:31.709596 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-80d334ac-8567-44f4-878e-c03b56102f0a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:31.713696 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-bf3879cf-d2e8-4a7d-a5e5-0fa275c5cc92 req-42a328df-2508-458b-8a60-c43141034ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b27c20-a6cd-4dd3-9506-1d132be6e635", "name": "network-vif-deleted", "tag": "28a6a33f-244e-40a2-b8a1-14db1a5fb3ba"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:03:31.721855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-80d334ac-8567-44f4-878e-c03b56102f0a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:31.722432 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-80d334ac-8567-44f4-878e-c03b56102f0a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:31.722652 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-bf3879cf-d2e8-4a7d-a5e5-0fa275c5cc92 req-42a328df-2508-458b-8a60-c43141034ba6 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:31.723065 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-bf3879cf-d2e8-4a7d-a5e5-0fa275c5cc92 req-42a328df-2508-458b-8a60-c43141034ba6 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:31.723242 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-80d334ac-8567-44f4-878e-c03b56102f0a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:31.729149 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-80d334ac-8567-44f4-878e-c03b56102f0a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:31.735045 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-bf3879cf-d2e8-4a7d-a5e5-0fa275c5cc92 req-42a328df-2508-458b-8a60-c43141034ba6 service nova] Creating event network-vif-deleted:28a6a33f-244e-40a2-b8a1-14db1a5fb3ba for instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 on hv-cinder-83699 May 23 11:03:31.740325 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-bf3879cf-d2e8-4a7d-a5e5-0fa275c5cc92 req-42a328df-2508-458b-8a60-c43141034ba6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030752 May 23 11:03:31.740933 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 481/975] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:03:31.795831 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-80d334ac-8567-44f4-878e-c03b56102f0a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43568344bfa54dd7a6b2cb5fe34422d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c085ae456b46460ea86e4cf1dfd819c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:31.803348 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-80d334ac-8567-44f4-878e-c03b56102f0a tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 200 len: 1382 microversion: 2.1 time: 0.099523 May 23 11:03:31.804033 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 495/976] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:31 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 1382 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:32.213357 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:03:32.213625 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Mon May 23 11:03:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 11:03:32.821562 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-dca7941f-14ec-4ad0-a4b8-35c12ea88de7 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:32.822285 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-dca7941f-14ec-4ad0-a4b8-35c12ea88de7 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] [instance: 32b27c20-a6cd-4dd3-9506-1d132be6e635] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:32.828500 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dca7941f-14ec-4ad0-a4b8-35c12ea88de7 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:32.828944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dca7941f-14ec-4ad0-a4b8-35c12ea88de7 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:32.829697 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dca7941f-14ec-4ad0-a4b8-35c12ea88de7 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:32.830167 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dca7941f-14ec-4ad0-a4b8-35c12ea88de7 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:32.843354 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-dca7941f-14ec-4ad0-a4b8-35c12ea88de7 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] HTTP exception thrown: Instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 could not be found. May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-dca7941f-14ec-4ad0-a4b8-35c12ea88de7 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Request method failure captured: May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 HTTP/1.1 May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2jIQvsdOf9FrQqpkBe0hndrv0scDZiv-bAXJJXUK2m_oPsTN5jio3wpIP64q9nk7RHuotuy_OHv3iwt2iwJPIuRlqszBjT88VPQf4B_f7o6947w1bf7fiKvQppNNnmrnsGKgWZAqTuIulYJ-L-EiotR2NjZHIQKEltsZCIAMGTzeDM May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: c085ae456b46460ea86e4cf1dfd819c2 May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-TestShelveInstance-775551506 May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 11:03:32.844928 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c085ae456b46460ea86e4cf1dfd819c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c085ae456b46460ea86e4cf1dfd819c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c085ae456b46460ea86e4cf1dfd819c2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c085ae456b46460ea86e4cf1dfd819c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-TestShelveInstance-775551506 May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: c085ae456b46460ea86e4cf1dfd819c2 May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-TestShelveInstance-775551506 May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-TestShelveInstance-775551506-project May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 43568344bfa54dd7a6b2cb5fe34422d7 May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-TestShelveInstance-775551506-project May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 could not be found. May 23 11:03:32.846653 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': '32b27c20-a6cd-4dd3-9506-1d132be6e635'} May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 could not be found. May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 11:03:32.847675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 could not be found. May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 could not be found. May 23 11:03:32.849248 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:32.850728 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-dca7941f-14ec-4ad0-a4b8-35c12ea88de7 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Returning 404 to user: Instance 32b27c20-a6cd-4dd3-9506-1d132be6e635 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 11:03:32.850728 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-dca7941f-14ec-4ad0-a4b8-35c12ea88de7 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635" status: 404 len: 111 microversion: 2.1 time: 0.029522 May 23 11:03:32.850728 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 482/977] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:32 2022] GET /compute/v2.1/servers/32b27c20-a6cd-4dd3-9506-1d132be6e635 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 11:03:33.002663 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6cb94901-1c4b-4689-94bf-c158d01fb935 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] Calling method '.version_select at 0x7fe72024b790>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:33.021161 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6cb94901-1c4b-4689-94bf-c158d01fb935 tempest-TestShelveInstance-775551506 tempest-TestShelveInstance-775551506-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-637878101" status: 202 len: 0 microversion: 2.1 time: 0.022526 May 23 11:03:33.021749 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 496/978] 10.222.0.36 () {58 vars in 1250 bytes} [Mon May 23 11:03:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-637878101 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:03:48.980425 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-231bae00-dacf-47be-bcef-a0f72bcef4ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1637974551"}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:03:48.981042 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-231bae00-dacf-47be-bcef-a0f72bcef4ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:48.983451 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:48.984094 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:48.989852 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-231bae00-dacf-47be-bcef-a0f72bcef4ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:48.990328 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-231bae00-dacf-47be-bcef-a0f72bcef4ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:48.991084 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-231bae00-dacf-47be-bcef-a0f72bcef4ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:48.991518 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-231bae00-dacf-47be-bcef-a0f72bcef4ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:49.119955 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.network.security_group_api [None req-231bae00-dacf-47be-bcef-a0f72bcef4ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Removing security group 39f095c8-db44-462e-a64b-d30e2cf67878 from port bae4a123-9d28-40c2-a622-78818f3c9569 May 23 11:03:49.482533 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-231bae00-dacf-47be-bcef-a0f72bcef4ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "POST /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/action" status: 202 len: 0 microversion: 2.1 time: 0.505962 May 23 11:03:49.483523 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 483/979] 10.222.0.36 () {60 vars in 1277 bytes} [Mon May 23 11:03:48 2022] POST /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:03:49.495919 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-b6accb2d-c0fe-43bc-9876-ec1011edeb74 req-fdd996d9-753d-460e-901a-dd7f7dd7b4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9139f29e-ed6d-4b8c-a8f1-8b7b4899857d", "tag": "bae4a123-9d28-40c2-a622-78818f3c9569"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:03:49.524653 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=14 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:49.526614 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:03:49.529602 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-b6accb2d-c0fe-43bc-9876-ec1011edeb74 req-fdd996d9-753d-460e-901a-dd7f7dd7b4a7 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:49.530538 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-b6accb2d-c0fe-43bc-9876-ec1011edeb74 req-fdd996d9-753d-460e-901a-dd7f7dd7b4a7 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:49.549491 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-b6accb2d-c0fe-43bc-9876-ec1011edeb74 req-fdd996d9-753d-460e-901a-dd7f7dd7b4a7 service nova] Creating event network-changed:bae4a123-9d28-40c2-a622-78818f3c9569 for instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d on hv-cinder-83699 May 23 11:03:49.560875 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-b6accb2d-c0fe-43bc-9876-ec1011edeb74 req-fdd996d9-753d-460e-901a-dd7f7dd7b4a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072976 May 23 11:03:49.561926 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 497/980] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:03:51.087097 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1987a358-e96b-4c26-90ce-34c935e0705a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:51.087594 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1987a358-e96b-4c26-90ce-34c935e0705a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:51.093622 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1987a358-e96b-4c26-90ce-34c935e0705a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:51.094098 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1987a358-e96b-4c26-90ce-34c935e0705a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:51.094865 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1987a358-e96b-4c26-90ce-34c935e0705a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:51.095300 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1987a358-e96b-4c26-90ce-34c935e0705a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:51.177177 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.objects.instance [None req-1987a358-e96b-4c26-90ce-34c935e0705a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lazy-loading 'services' on Instance uuid 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d {{(pid=129030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 11:03:51.251453 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1987a358-e96b-4c26-90ce-34c935e0705a tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments/d4bdd631-5149-4bf1-956a-ce18588239b7" status: 202 len: 0 microversion: 2.1 time: 0.168608 May 23 11:03:51.252084 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 484/981] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 11:03:51 2022] DELETE /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments/d4bdd631-5149-4bf1-956a-ce18588239b7 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:03:51.261185 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-8c27f061-ee4f-453d-8b79-fbfe58f399d5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:51.262244 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-8c27f061-ee4f-453d-8b79-fbfe58f399d5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:51.269456 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8c27f061-ee4f-453d-8b79-fbfe58f399d5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:51.269914 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8c27f061-ee4f-453d-8b79-fbfe58f399d5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:51.270737 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8c27f061-ee4f-453d-8b79-fbfe58f399d5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:51.271199 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-8c27f061-ee4f-453d-8b79-fbfe58f399d5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:51.301568 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-8c27f061-ee4f-453d-8b79-fbfe58f399d5 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 May 23 11:03:51.302074 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 498/982] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 11:03:51 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:03:51.576277 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-ffd7c731-df5c-4ca9-919c-61676b054e96 req-4ac0a93c-ddac-43eb-8cc2-1e5c31dcd40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9139f29e-ed6d-4b8c-a8f1-8b7b4899857d", "tag": "bae4a123-9d28-40c2-a622-78818f3c9569"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:03:51.584802 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-ffd7c731-df5c-4ca9-919c-61676b054e96 req-4ac0a93c-ddac-43eb-8cc2-1e5c31dcd40a service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:51.585244 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-ffd7c731-df5c-4ca9-919c-61676b054e96 req-4ac0a93c-ddac-43eb-8cc2-1e5c31dcd40a service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:51.596557 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-ffd7c731-df5c-4ca9-919c-61676b054e96 req-4ac0a93c-ddac-43eb-8cc2-1e5c31dcd40a service nova] Creating event network-changed:bae4a123-9d28-40c2-a622-78818f3c9569 for instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d on hv-cinder-83699 May 23 11:03:51.601362 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-ffd7c731-df5c-4ca9-919c-61676b054e96 req-4ac0a93c-ddac-43eb-8cc2-1e5c31dcd40a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029158 May 23 11:03:51.602811 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 485/983] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:03:52.312855 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-71d555d1-a288-4941-80d3-980c147724d8 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:52.313770 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-71d555d1-a288-4941-80d3-980c147724d8 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:52.320862 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-71d555d1-a288-4941-80d3-980c147724d8 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:52.321331 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-71d555d1-a288-4941-80d3-980c147724d8 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:52.322152 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-71d555d1-a288-4941-80d3-980c147724d8 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:52.322594 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-71d555d1-a288-4941-80d3-980c147724d8 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:52.350644 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-71d555d1-a288-4941-80d3-980c147724d8 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041756 May 23 11:03:52.351211 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 499/984] 10.222.0.36 () {58 vars in 1301 bytes} [Mon May 23 11:03:52 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 11:03:52.362117 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4804bf85-ba4b-4e16-b07d-94ca3fa9d4b3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:52.362699 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4804bf85-ba4b-4e16-b07d-94ca3fa9d4b3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:52.369527 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4804bf85-ba4b-4e16-b07d-94ca3fa9d4b3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:52.369944 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4804bf85-ba4b-4e16-b07d-94ca3fa9d4b3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:52.370740 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4804bf85-ba4b-4e16-b07d-94ca3fa9d4b3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:52.371175 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4804bf85-ba4b-4e16-b07d-94ca3fa9d4b3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:52.447035 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-4804bf85-ba4b-4e16-b07d-94ca3fa9d4b3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] HTTP exception thrown: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d is not attached to volume d4bdd631-5149-4bf1-956a-ce18588239b7 May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4804bf85-ba4b-4e16-b07d-94ca3fa9d4b3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Request method failure captured: May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: DELETE /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments/d4bdd631-5149-4bf1-956a-ce18588239b7 HTTP/1.1 May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2mhAUpYMDfcPc_vJnm_a1v_ZnRYVLD2x2vEZ2pP9LoZHm-Rxt1wCN3K8SY7SG-abeVJIVZ6ie0_YgLnFW7B6NaycOv8gD3TpmnX0a4VzP4KRJcPWQ5MS_M_4xsV0AsKnwMklLa10DM-Wd84HC6_4zW52jW6hUoKrxrv-NArKkqRUfs May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: e35c886cdaaf465eacd001e132128cbd May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-TestMinimumBasicScenario-295020283 May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 11:03:52.449460 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e35c886cdaaf465eacd001e132128cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e35c886cdaaf465eacd001e132128cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e35c886cdaaf465eacd001e132128cbd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e35c886cdaaf465eacd001e132128cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-TestMinimumBasicScenario-295020283 May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: e35c886cdaaf465eacd001e132128cbd May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-TestMinimumBasicScenario-295020283 May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-TestMinimumBasicScenario-295020283-project May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 88701ef1915d4ad2955a4bf31fe7634b May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-TestMinimumBasicScenario-295020283-project May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 11:03:52.451184 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d is not attached to volume d4bdd631-5149-4bf1-956a-ce18588239b7 May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'server_id': '9139f29e-ed6d-4b8c-a8f1-8b7b4899857d', 'id': 'd4bdd631-5149-4bf1-956a-ce18588239b7'} May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d4bdd631-5149-4bf1-956a-ce18588239b7. May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 11:03:52.452108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d is not attached to volume d4bdd631-5149-4bf1-956a-ce18588239b7 May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d is not attached to volume d4bdd631-5149-4bf1-956a-ce18588239b7 May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:52.453744 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4804bf85-ba4b-4e16-b07d-94ca3fa9d4b3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Returning 404 to user: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d is not attached to volume d4bdd631-5149-4bf1-956a-ce18588239b7 {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 11:03:52.454888 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4804bf85-ba4b-4e16-b07d-94ca3fa9d4b3 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments/d4bdd631-5149-4bf1-956a-ce18588239b7" status: 404 len: 154 microversion: 2.1 time: 0.093651 May 23 11:03:52.454888 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 486/985] 10.222.0.36 () {58 vars in 1415 bytes} [Mon May 23 11:03:52 2022] DELETE /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d/os-volume_attachments/d4bdd631-5149-4bf1-956a-ce18588239b7 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 11:03:53.582372 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-4c1afce2-df6f-40cc-b2c6-5012bf63860c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:53.582874 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-4c1afce2-df6f-40cc-b2c6-5012bf63860c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:53.589450 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4c1afce2-df6f-40cc-b2c6-5012bf63860c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:53.589895 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4c1afce2-df6f-40cc-b2c6-5012bf63860c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:53.590715 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4c1afce2-df6f-40cc-b2c6-5012bf63860c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:53.591150 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-4c1afce2-df6f-40cc-b2c6-5012bf63860c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:53.619223 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-4c1afce2-df6f-40cc-b2c6-5012bf63860c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 11:03:53.696194 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-4c1afce2-df6f-40cc-b2c6-5012bf63860c tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 204 len: 0 microversion: 2.1 time: 0.117326 May 23 11:03:53.696778 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 500/986] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 11:03:53 2022] DELETE /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 11:03:53.705691 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ee3095c1-d614-4824-8d87-bc9b7fff6c83 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:53.706327 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ee3095c1-d614-4824-8d87-bc9b7fff6c83 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:53.713340 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ee3095c1-d614-4824-8d87-bc9b7fff6c83 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:53.713792 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ee3095c1-d614-4824-8d87-bc9b7fff6c83 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:53.714587 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ee3095c1-d614-4824-8d87-bc9b7fff6c83 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:53.715024 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ee3095c1-d614-4824-8d87-bc9b7fff6c83 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:53.843262 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ee3095c1-d614-4824-8d87-bc9b7fff6c83 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:53.850776 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ee3095c1-d614-4824-8d87-bc9b7fff6c83 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1555 microversion: 2.1 time: 0.149016 May 23 11:03:53.851347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 487/987] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:53 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:54.869546 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-f40e4bd5-d615-477b-8139-5be860e47626 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:54.870273 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-f40e4bd5-d615-477b-8139-5be860e47626 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:54.876689 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f40e4bd5-d615-477b-8139-5be860e47626 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:54.877140 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f40e4bd5-d615-477b-8139-5be860e47626 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:54.877902 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f40e4bd5-d615-477b-8139-5be860e47626 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:54.878362 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-f40e4bd5-d615-477b-8139-5be860e47626 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:55.003195 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-f40e4bd5-d615-477b-8139-5be860e47626 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:55.010624 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-f40e4bd5-d615-477b-8139-5be860e47626 tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1555 microversion: 2.1 time: 0.145982 May 23 11:03:55.011187 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 501/988] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:54 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:56.027783 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-5aaf1fe7-e1e2-49c8-b16c-0a4e3e6a52ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:56.028401 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-5aaf1fe7-e1e2-49c8-b16c-0a4e3e6a52ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:56.034718 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5aaf1fe7-e1e2-49c8-b16c-0a4e3e6a52ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:56.035171 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5aaf1fe7-e1e2-49c8-b16c-0a4e3e6a52ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:56.036110 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5aaf1fe7-e1e2-49c8-b16c-0a4e3e6a52ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:56.036524 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-5aaf1fe7-e1e2-49c8-b16c-0a4e3e6a52ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:56.234862 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-5aaf1fe7-e1e2-49c8-b16c-0a4e3e6a52ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88701ef1915d4ad2955a4bf31fe7634b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c886cdaaf465eacd001e132128cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:03:56.244091 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-5aaf1fe7-e1e2-49c8-b16c-0a4e3e6a52ac tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 200 len: 1555 microversion: 2.1 time: 0.220555 May 23 11:03:56.244893 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 488/989] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:56 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 1555 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:03:56.343950 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-8c47e29a-5b06-4f2e-b672-b7e57cc26490 req-fbec0583-9cf7-4853-8921-ce2426569eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9139f29e-ed6d-4b8c-a8f1-8b7b4899857d", "name": "network-vif-deleted", "tag": "bae4a123-9d28-40c2-a622-78818f3c9569"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:03:56.353043 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-8c47e29a-5b06-4f2e-b672-b7e57cc26490 req-fbec0583-9cf7-4853-8921-ce2426569eec service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:56.353612 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-8c47e29a-5b06-4f2e-b672-b7e57cc26490 req-fbec0583-9cf7-4853-8921-ce2426569eec service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:56.365355 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-8c47e29a-5b06-4f2e-b672-b7e57cc26490 req-fbec0583-9cf7-4853-8921-ce2426569eec service nova] Creating event network-vif-deleted:bae4a123-9d28-40c2-a622-78818f3c9569 for instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d on hv-cinder-83699 May 23 11:03:56.371097 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-8c47e29a-5b06-4f2e-b672-b7e57cc26490 req-fbec0583-9cf7-4853-8921-ce2426569eec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030845 May 23 11:03:56.371711 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 502/990] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 11:03:57.261275 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-632f70da-62ea-4de0-8e2c-23f35ed3315d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:57.261892 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-632f70da-62ea-4de0-8e2c-23f35ed3315d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] [instance: 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:03:57.267966 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-632f70da-62ea-4de0-8e2c-23f35ed3315d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:57.268423 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-632f70da-62ea-4de0-8e2c-23f35ed3315d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:57.269193 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-632f70da-62ea-4de0-8e2c-23f35ed3315d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:03:57.269632 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-632f70da-62ea-4de0-8e2c-23f35ed3315d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:03:57.283645 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-632f70da-62ea-4de0-8e2c-23f35ed3315d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] HTTP exception thrown: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d could not be found. May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-632f70da-62ea-4de0-8e2c-23f35ed3315d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Request method failure captured: May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d HTTP/1.1 May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2mhAUpYMDfcPc_vJnm_a1v_ZnRYVLD2x2vEZ2pP9LoZHm-Rxt1wCN3K8SY7SG-abeVJIVZ6ie0_YgLnFW7B6NaycOv8gD3TpmnX0a4VzP4KRJcPWQ5MS_M_4xsV0AsKnwMklLa10DM-Wd84HC6_4zW52jW6hUoKrxrv-NArKkqRUfs May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: e35c886cdaaf465eacd001e132128cbd May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-TestMinimumBasicScenario-295020283 May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 11:03:57.285150 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e35c886cdaaf465eacd001e132128cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e35c886cdaaf465eacd001e132128cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e35c886cdaaf465eacd001e132128cbd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e35c886cdaaf465eacd001e132128cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-TestMinimumBasicScenario-295020283 May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: e35c886cdaaf465eacd001e132128cbd May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-TestMinimumBasicScenario-295020283 May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-TestMinimumBasicScenario-295020283-project May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 88701ef1915d4ad2955a4bf31fe7634b May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-TestMinimumBasicScenario-295020283-project May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d could not be found. May 23 11:03:57.286769 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': '9139f29e-ed6d-4b8c-a8f1-8b7b4899857d'} May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d could not be found. May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 11:03:57.287876 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d could not be found. May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d could not be found. May 23 11:03:57.289424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:03:57.290984 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-632f70da-62ea-4de0-8e2c-23f35ed3315d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Returning 404 to user: Instance 9139f29e-ed6d-4b8c-a8f1-8b7b4899857d could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 11:03:57.290984 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-632f70da-62ea-4de0-8e2c-23f35ed3315d tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d" status: 404 len: 111 microversion: 2.1 time: 0.029830 May 23 11:03:57.290984 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 489/991] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:03:57 2022] GET /compute/v2.1/servers/9139f29e-ed6d-4b8c-a8f1-8b7b4899857d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 11:03:57.295611 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d3faaf92-ab3f-4b78-89be-5582e51b67aa tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] Calling method '.version_select at 0x7fe720077940>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:03:57.312227 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d3faaf92-ab3f-4b78-89be-5582e51b67aa tempest-TestMinimumBasicScenario-295020283 tempest-TestMinimumBasicScenario-295020283-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1563166334" status: 202 len: 0 microversion: 2.1 time: 0.020682 May 23 11:03:57.312706 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 503/992] 10.222.0.36 () {58 vars in 1271 bytes} [Mon May 23 11:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1563166334 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:04:46.667692 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1652282727", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1840680101", "security_groups": [{"name": "tempest-secgroup-smoke-595907096"}], "block_device_mapping_v2": [{"uuid": "4b0db4de-6b2e-4f70-a740-36ffbbe1288e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b814bad-a4b2-460e-a94c-57193f7a8608"}]}} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:04:46.675911 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=14 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:04:46.676558 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:04:46.781663 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.network.neutron [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] validate_networks() for [('3b814bad-a4b2-460e-a94c-57193f7a8608', None, None, None, None, None)] {{(pid=129030) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 11:04:47.252244 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Flavor limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 11:04:47.252675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Image limits 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 11:04:47.253180 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Flavor pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 11:04:47.253596 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Image pref 0:0:0 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 11:04:47.254047 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.virt.hardware [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 11:04:47.263542 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:47.263999 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:47.264804 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:47.265247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:47.282701 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Getting quotas for project 86e332b470c841db8d7d852c1c0a4a26. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 11:04:47.286670 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.quota [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Getting quotas for user 5b53f05946e34f9f8395526212c5b17f and project 86e332b470c841db8d7d852c1c0a4a26. Resources: {'instances', 'cores', 'ram'} {{(pid=129030) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 11:04:47.342753 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Going to run 1 instances... {{(pid=129030) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 11:04:47.344922 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b0db4de-6b2e-4f70-a740-36ffbbe1288e',volume_size=None,volume_type=None)] {{(pid=129030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 11:04:47.466949 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [122a770f-dbae-4c40-9960-108311ca55c6] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 11:04:48.476775 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [122a770f-dbae-4c40-9960-108311ca55c6] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 48370. May 23 11:04:48.480984 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-e5d1fdb9-1544-4a53-b777-e8ceb0afe41d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.817107 May 23 11:04:48.481810 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 490/993] 10.222.0.36 () {60 vars in 1146 bytes} [Mon May 23 11:04:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 11:04:48.489233 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:04:48.490432 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:04:48.632826 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2267c35a-5a98-4f56-9414-fd81f335082b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:48.633553 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2267c35a-5a98-4f56-9414-fd81f335082b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:48.685932 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2267c35a-5a98-4f56-9414-fd81f335082b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:04:48.693134 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2267c35a-5a98-4f56-9414-fd81f335082b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1095 microversion: 2.1 time: 0.205450 May 23 11:04:48.693683 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 504/994] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:48 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1095 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:04:49.711622 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-594ff2cf-4e32-41f6-af70-7b9485e9b7c5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:49.712232 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-594ff2cf-4e32-41f6-af70-7b9485e9b7c5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:49.763711 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-594ff2cf-4e32-41f6-af70-7b9485e9b7c5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:04:49.770370 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-594ff2cf-4e32-41f6-af70-7b9485e9b7c5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1095 microversion: 2.1 time: 0.063795 May 23 11:04:49.770929 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 491/995] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:49 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:04:50.788544 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-c70b607d-5618-4871-84d3-bca174ef71b5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:50.789154 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-c70b607d-5618-4871-84d3-bca174ef71b5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:50.842138 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-c70b607d-5618-4871-84d3-bca174ef71b5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:04:50.848818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-c70b607d-5618-4871-84d3-bca174ef71b5 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1095 microversion: 2.1 time: 0.064869 May 23 11:04:50.849389 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 505/996] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:50 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:04:51.865452 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ebbf6b82-e47b-4399-8b7b-66f7b2fc94b4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:51.866741 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ebbf6b82-e47b-4399-8b7b-66f7b2fc94b4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:51.873780 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ebbf6b82-e47b-4399-8b7b-66f7b2fc94b4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:51.874337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ebbf6b82-e47b-4399-8b7b-66f7b2fc94b4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:51.875112 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ebbf6b82-e47b-4399-8b7b-66f7b2fc94b4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:51.875577 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ebbf6b82-e47b-4399-8b7b-66f7b2fc94b4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:51.935083 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ebbf6b82-e47b-4399-8b7b-66f7b2fc94b4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:04:51.942440 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ebbf6b82-e47b-4399-8b7b-66f7b2fc94b4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1145 microversion: 2.1 time: 0.080948 May 23 11:04:51.943009 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 492/997] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:51 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:04:52.959708 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-d8cb79a8-4152-4782-bb4e-c4f643e03906 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:52.960511 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-d8cb79a8-4152-4782-bb4e-c4f643e03906 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:52.967907 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d8cb79a8-4152-4782-bb4e-c4f643e03906 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:52.968425 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d8cb79a8-4152-4782-bb4e-c4f643e03906 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:52.969258 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d8cb79a8-4152-4782-bb4e-c4f643e03906 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:52.969796 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-d8cb79a8-4152-4782-bb4e-c4f643e03906 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:53.030840 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-d8cb79a8-4152-4782-bb4e-c4f643e03906 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:04:53.038117 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-d8cb79a8-4152-4782-bb4e-c4f643e03906 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1145 microversion: 2.1 time: 0.082465 May 23 11:04:53.038673 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 506/998] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:52 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:04:54.055312 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-ecd88806-b1e0-4fdd-9280-f66635d24c55 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:54.055941 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-ecd88806-b1e0-4fdd-9280-f66635d24c55 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:54.062606 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ecd88806-b1e0-4fdd-9280-f66635d24c55 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:54.063065 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ecd88806-b1e0-4fdd-9280-f66635d24c55 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:54.063853 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ecd88806-b1e0-4fdd-9280-f66635d24c55 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:54.064297 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-ecd88806-b1e0-4fdd-9280-f66635d24c55 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:54.139058 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-ecd88806-b1e0-4fdd-9280-f66635d24c55 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:04:54.147035 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-ecd88806-b1e0-4fdd-9280-f66635d24c55 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1211 microversion: 2.1 time: 0.096083 May 23 11:04:54.147648 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 493/999] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:54 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:04:55.000015 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-3241914e-e49e-4cfb-b255-3f04e5500cb1 req-64058e92-1118-4f9e-b597-650b39753b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8a7f76-7980-44f9-8cd7-14bf83678e19", "tag": "3dd59820-9c6d-4ae2-9614-f101565b22bf"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:04:55.012060 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-3241914e-e49e-4cfb-b255-3f04e5500cb1 req-64058e92-1118-4f9e-b597-650b39753b22 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:55.013347 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-3241914e-e49e-4cfb-b255-3f04e5500cb1 req-64058e92-1118-4f9e-b597-650b39753b22 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:55.037727 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-3241914e-e49e-4cfb-b255-3f04e5500cb1 req-64058e92-1118-4f9e-b597-650b39753b22 service nova] Creating event network-changed:3dd59820-9c6d-4ae2-9614-f101565b22bf for instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 on hv-cinder-83699 May 23 11:04:55.043818 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-3241914e-e49e-4cfb-b255-3f04e5500cb1 req-64058e92-1118-4f9e-b597-650b39753b22 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048976 May 23 11:04:55.044887 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 507/1000] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 11:04:55.164759 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1cefc07a-47c8-4902-bd90-17316a6af6ea tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:55.165373 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1cefc07a-47c8-4902-bd90-17316a6af6ea tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:55.171994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1cefc07a-47c8-4902-bd90-17316a6af6ea tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:55.172450 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1cefc07a-47c8-4902-bd90-17316a6af6ea tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:55.173228 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1cefc07a-47c8-4902-bd90-17316a6af6ea tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:55.173674 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1cefc07a-47c8-4902-bd90-17316a6af6ea tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:55.385761 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1cefc07a-47c8-4902-bd90-17316a6af6ea tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:04:55.393149 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1cefc07a-47c8-4902-bd90-17316a6af6ea tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.232406 May 23 11:04:55.393720 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 494/1001] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:55 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:04:56.410586 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5452be9d-d0b5-4d32-97de-2fad27abcef4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:56.411289 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5452be9d-d0b5-4d32-97de-2fad27abcef4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:56.418361 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5452be9d-d0b5-4d32-97de-2fad27abcef4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:56.418816 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5452be9d-d0b5-4d32-97de-2fad27abcef4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:56.419587 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5452be9d-d0b5-4d32-97de-2fad27abcef4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:56.420032 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5452be9d-d0b5-4d32-97de-2fad27abcef4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:56.552788 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-5452be9d-d0b5-4d32-97de-2fad27abcef4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:04:56.560821 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5452be9d-d0b5-4d32-97de-2fad27abcef4 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.155029 May 23 11:04:56.561415 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 508/1002] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:56 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:04:57.577851 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-aaa86737-eb07-4be0-8a12-aab8d01ae089 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:57.578492 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-aaa86737-eb07-4be0-8a12-aab8d01ae089 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:57.580334 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=2 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:04:57.585877 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aaa86737-eb07-4be0-8a12-aab8d01ae089 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:57.586346 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aaa86737-eb07-4be0-8a12-aab8d01ae089 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:57.587114 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aaa86737-eb07-4be0-8a12-aab8d01ae089 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:57.587560 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-aaa86737-eb07-4be0-8a12-aab8d01ae089 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:57.713811 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-aaa86737-eb07-4be0-8a12-aab8d01ae089 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:04:57.721202 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-aaa86737-eb07-4be0-8a12-aab8d01ae089 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.147405 May 23 11:04:57.721762 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 495/1003] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:57 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:04:58.738235 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-6cd614ef-6079-49cf-85c1-8f1a04e85c61 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:58.738838 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-6cd614ef-6079-49cf-85c1-8f1a04e85c61 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:58.745306 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6cd614ef-6079-49cf-85c1-8f1a04e85c61 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:58.745752 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6cd614ef-6079-49cf-85c1-8f1a04e85c61 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:58.746550 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6cd614ef-6079-49cf-85c1-8f1a04e85c61 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:58.746978 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-6cd614ef-6079-49cf-85c1-8f1a04e85c61 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:58.874192 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-6cd614ef-6079-49cf-85c1-8f1a04e85c61 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:04:58.881655 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-6cd614ef-6079-49cf-85c1-8f1a04e85c61 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.147299 May 23 11:04:58.882903 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 509/1004] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:58 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:04:59.899484 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-a3af1b70-fafc-48a0-9f81-98c848a6526b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:04:59.900384 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-a3af1b70-fafc-48a0-9f81-98c848a6526b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:04:59.902662 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell0:SELECT=8 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:04:59.908186 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a3af1b70-fafc-48a0-9f81-98c848a6526b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:59.908632 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a3af1b70-fafc-48a0-9f81-98c848a6526b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:04:59.909391 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a3af1b70-fafc-48a0-9f81-98c848a6526b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:04:59.909854 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-a3af1b70-fafc-48a0-9f81-98c848a6526b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:00.038289 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-a3af1b70-fafc-48a0-9f81-98c848a6526b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:05:00.045799 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-a3af1b70-fafc-48a0-9f81-98c848a6526b tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.150704 May 23 11:05:00.046405 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 496/1005] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:04:59 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:05:01.063014 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-53c25ec4-3958-4318-a0a3-c8571e7f824e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:05:01.063634 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-53c25ec4-3958-4318-a0a3-c8571e7f824e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:05:01.066046 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell0:SELECT=4 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:05:01.071574 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-53c25ec4-3958-4318-a0a3-c8571e7f824e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:01.072029 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-53c25ec4-3958-4318-a0a3-c8571e7f824e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:01.072801 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-53c25ec4-3958-4318-a0a3-c8571e7f824e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:01.073244 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-53c25ec4-3958-4318-a0a3-c8571e7f824e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:01.204073 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-53c25ec4-3958-4318-a0a3-c8571e7f824e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:05:01.212074 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-53c25ec4-3958-4318-a0a3-c8571e7f824e tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.152927 May 23 11:05:01.212650 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 510/1006] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:05:01 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:05:02.228752 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-786f520f-41a6-4cc3-be86-6a308ca982b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:05:02.229358 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-786f520f-41a6-4cc3-be86-6a308ca982b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:05:02.236002 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-786f520f-41a6-4cc3-be86-6a308ca982b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:02.236449 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-786f520f-41a6-4cc3-be86-6a308ca982b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:02.237219 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-786f520f-41a6-4cc3-be86-6a308ca982b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:02.237650 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-786f520f-41a6-4cc3-be86-6a308ca982b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:02.369158 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-786f520f-41a6-4cc3-be86-6a308ca982b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:05:02.376624 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-786f520f-41a6-4cc3-be86-6a308ca982b3 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.151785 May 23 11:05:02.377195 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 497/1007] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:05:02 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:05:03.394529 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-ebc7d4c9-4e99-436c-a228-fd36c9d3147f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:05:03.395290 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-ebc7d4c9-4e99-436c-a228-fd36c9d3147f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:05:03.402196 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ebc7d4c9-4e99-436c-a228-fd36c9d3147f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:03.402643 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ebc7d4c9-4e99-436c-a228-fd36c9d3147f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:03.403409 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ebc7d4c9-4e99-436c-a228-fd36c9d3147f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:03.403841 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-ebc7d4c9-4e99-436c-a228-fd36c9d3147f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:03.536590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-ebc7d4c9-4e99-436c-a228-fd36c9d3147f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:05:03.544056 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-ebc7d4c9-4e99-436c-a228-fd36c9d3147f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.153924 May 23 11:05:03.544615 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 511/1008] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:05:03 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:05:04.560949 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-2681ac7c-e809-4692-bff0-249d333221ec tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:05:04.561563 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-2681ac7c-e809-4692-bff0-249d333221ec tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:05:04.568086 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2681ac7c-e809-4692-bff0-249d333221ec tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:04.568540 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2681ac7c-e809-4692-bff0-249d333221ec tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:04.569309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2681ac7c-e809-4692-bff0-249d333221ec tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:04.570275 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-2681ac7c-e809-4692-bff0-249d333221ec tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:04.696865 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-2681ac7c-e809-4692-bff0-249d333221ec tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:05:04.704154 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-2681ac7c-e809-4692-bff0-249d333221ec tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.147038 May 23 11:05:04.704717 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 498/1009] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:05:04 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:05:05.486109 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-1ff7899e-fa57-4a0b-8841-db039e6ab02b req-2381306d-2993-4595-8f0d-9557d2af608d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8a7f76-7980-44f9-8cd7-14bf83678e19", "name": "network-vif-plugged", "status": "completed", "tag": "3dd59820-9c6d-4ae2-9614-f101565b22bf"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:05:05.494760 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-1ff7899e-fa57-4a0b-8841-db039e6ab02b req-2381306d-2993-4595-8f0d-9557d2af608d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:05.495215 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-1ff7899e-fa57-4a0b-8841-db039e6ab02b req-2381306d-2993-4595-8f0d-9557d2af608d service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:05.506645 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-1ff7899e-fa57-4a0b-8841-db039e6ab02b req-2381306d-2993-4595-8f0d-9557d2af608d service nova] Creating event network-vif-plugged:3dd59820-9c6d-4ae2-9614-f101565b22bf for instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 on hv-cinder-83699 May 23 11:05:05.511545 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-1ff7899e-fa57-4a0b-8841-db039e6ab02b req-2381306d-2993-4595-8f0d-9557d2af608d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084184 May 23 11:05:05.512122 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 512/1010] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:05:05.721638 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-1d34a54e-97d3-4764-83e8-55987914bf31 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:05:05.722201 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-1d34a54e-97d3-4764-83e8-55987914bf31 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:05:05.729265 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1d34a54e-97d3-4764-83e8-55987914bf31 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:05.729708 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1d34a54e-97d3-4764-83e8-55987914bf31 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:05.730502 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1d34a54e-97d3-4764-83e8-55987914bf31 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:05.730929 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-1d34a54e-97d3-4764-83e8-55987914bf31 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:05.920075 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-1d34a54e-97d3-4764-83e8-55987914bf31 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:05:05.928166 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-1d34a54e-97d3-4764-83e8-55987914bf31 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.210463 May 23 11:05:05.929250 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 499/1011] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:05:05 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:05:06.945901 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-699bf362-d0e1-4cd6-950d-275f9a4f37ff tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:05:06.946630 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-699bf362-d0e1-4cd6-950d-275f9a4f37ff tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:05:06.952923 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-699bf362-d0e1-4cd6-950d-275f9a4f37ff tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:06.953376 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-699bf362-d0e1-4cd6-950d-275f9a4f37ff tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:06.954176 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-699bf362-d0e1-4cd6-950d-275f9a4f37ff tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:06.954623 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-699bf362-d0e1-4cd6-950d-275f9a4f37ff tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:07.087332 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-699bf362-d0e1-4cd6-950d-275f9a4f37ff tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:05:07.095095 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-699bf362-d0e1-4cd6-950d-275f9a4f37ff tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1266 microversion: 2.1 time: 0.153970 May 23 11:05:07.095668 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 513/1012] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:05:06 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:05:08.112333 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-9bae19b8-3115-41f4-8a68-a72867df8186 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:05:08.112941 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-9bae19b8-3115-41f4-8a68-a72867df8186 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:05:08.120043 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9bae19b8-3115-41f4-8a68-a72867df8186 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:08.120494 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9bae19b8-3115-41f4-8a68-a72867df8186 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:08.121254 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9bae19b8-3115-41f4-8a68-a72867df8186 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:08.121690 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-9bae19b8-3115-41f4-8a68-a72867df8186 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:08.254704 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-9bae19b8-3115-41f4-8a68-a72867df8186 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:05:08.263067 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-9bae19b8-3115-41f4-8a68-a72867df8186 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1454 microversion: 2.1 time: 0.154680 May 23 11:05:08.263636 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 500/1013] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:05:08 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:05:08.279266 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-712189d5-c556-4ea8-9f55-2bb60d3cdb04 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:05:08.279880 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-712189d5-c556-4ea8-9f55-2bb60d3cdb04 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:05:08.286491 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-712189d5-c556-4ea8-9f55-2bb60d3cdb04 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:08.286945 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-712189d5-c556-4ea8-9f55-2bb60d3cdb04 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:08.287745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-712189d5-c556-4ea8-9f55-2bb60d3cdb04 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:08.288689 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-712189d5-c556-4ea8-9f55-2bb60d3cdb04 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:08.419870 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-712189d5-c556-4ea8-9f55-2bb60d3cdb04 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:05:08.427330 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-712189d5-c556-4ea8-9f55-2bb60d3cdb04 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1454 microversion: 2.1 time: 0.152220 May 23 11:05:08.427903 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 514/1014] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:05:08 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:05:10.312475 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-122deb33-a834-404d-a51b-0ff847413a79 req-e780dc42-2bb0-4b48-b3d8-34839d1f7121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8a7f76-7980-44f9-8cd7-14bf83678e19", "tag": "3dd59820-9c6d-4ae2-9614-f101565b22bf"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:05:10.321062 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-122deb33-a834-404d-a51b-0ff847413a79 req-e780dc42-2bb0-4b48-b3d8-34839d1f7121 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:05:10.321503 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-122deb33-a834-404d-a51b-0ff847413a79 req-e780dc42-2bb0-4b48-b3d8-34839d1f7121 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:05:10.334293 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-122deb33-a834-404d-a51b-0ff847413a79 req-e780dc42-2bb0-4b48-b3d8-34839d1f7121 service nova] Creating event network-changed:3dd59820-9c6d-4ae2-9614-f101565b22bf for instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 on hv-cinder-83699 May 23 11:05:10.339477 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-122deb33-a834-404d-a51b-0ff847413a79 req-e780dc42-2bb0-4b48-b3d8-34839d1f7121 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090091 May 23 11:05:10.340342 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 501/1015] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:05:19.995727 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:05:19.996335 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Mon May 23 11:05:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 11:06:38.498749 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_api:SELECT=26 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:06:38.499637 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG dbcounter [-] [129029] Writing DB stats nova_cell1:SELECT=46 {{(pid=129029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:06:38.501756 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:06:38.502935 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG dbcounter [-] [129030] Writing DB stats nova_cell1:SELECT=58 {{(pid=129030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 11:06:38.503836 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-3d7f72f6-831f-4180-ba55-cf8f1562369d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:38.504532 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3d7f72f6-831f-4180-ba55-cf8f1562369d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:38.509329 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-584e380c-a899-4b10-91f9-85a8f8ca50fc req-62e405de-593f-4c93-9cfc-b0ca427e9414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8a7f76-7980-44f9-8cd7-14bf83678e19", "tag": "3dd59820-9c6d-4ae2-9614-f101565b22bf"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:06:38.511189 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3d7f72f6-831f-4180-ba55-cf8f1562369d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:38.511651 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3d7f72f6-831f-4180-ba55-cf8f1562369d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:38.512430 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3d7f72f6-831f-4180-ba55-cf8f1562369d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:38.513048 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-3d7f72f6-831f-4180-ba55-cf8f1562369d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:38.519422 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-584e380c-a899-4b10-91f9-85a8f8ca50fc req-62e405de-593f-4c93-9cfc-b0ca427e9414 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:38.520108 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-584e380c-a899-4b10-91f9-85a8f8ca50fc req-62e405de-593f-4c93-9cfc-b0ca427e9414 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:38.532277 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-584e380c-a899-4b10-91f9-85a8f8ca50fc req-62e405de-593f-4c93-9cfc-b0ca427e9414 service nova] Creating event network-changed:3dd59820-9c6d-4ae2-9614-f101565b22bf for instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 on hv-cinder-83699 May 23 11:06:38.538066 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-584e380c-a899-4b10-91f9-85a8f8ca50fc req-62e405de-593f-4c93-9cfc-b0ca427e9414 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038713 May 23 11:06:38.538864 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 502/1016] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:06:38.542635 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-3d7f72f6-831f-4180-ba55-cf8f1562369d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Going to try to terminate instance {{(pid=129029) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 11:06:38.627239 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-3d7f72f6-831f-4180-ba55-cf8f1562369d tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 204 len: 0 microversion: 2.1 time: 0.130124 May 23 11:06:38.628717 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 515/1017] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 11:06:38 2022] DELETE /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 11:06:38.637462 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-926d7d3d-815c-4560-b121-c16ace6b3d59 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:38.638349 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-926d7d3d-815c-4560-b121-c16ace6b3d59 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:38.645013 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-926d7d3d-815c-4560-b121-c16ace6b3d59 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:38.645465 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-926d7d3d-815c-4560-b121-c16ace6b3d59 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:38.646814 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-926d7d3d-815c-4560-b121-c16ace6b3d59 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:38.647247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-926d7d3d-815c-4560-b121-c16ace6b3d59 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:38.776257 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-926d7d3d-815c-4560-b121-c16ace6b3d59 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:06:38.784320 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-926d7d3d-815c-4560-b121-c16ace6b3d59 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1579 microversion: 2.1 time: 0.151185 May 23 11:06:38.784906 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 503/1018] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:06:38 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1579 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 11:06:39.804133 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-0dbae264-1f47-4d05-9665-ab500e56ab58 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:39.804850 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-0dbae264-1f47-4d05-9665-ab500e56ab58 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:39.811444 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0dbae264-1f47-4d05-9665-ab500e56ab58 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:39.811892 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0dbae264-1f47-4d05-9665-ab500e56ab58 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:39.812654 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0dbae264-1f47-4d05-9665-ab500e56ab58 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:39.813093 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-0dbae264-1f47-4d05-9665-ab500e56ab58 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:40.001536 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-0dbae264-1f47-4d05-9665-ab500e56ab58 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:06:40.009176 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-0dbae264-1f47-4d05-9665-ab500e56ab58 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1579 microversion: 2.1 time: 0.209841 May 23 11:06:40.009745 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 516/1019] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:06:39 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1579 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:06:41.027727 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-b83ac8d2-cece-4bf9-bb57-a42025cf26d7 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:41.028347 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-b83ac8d2-cece-4bf9-bb57-a42025cf26d7 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:41.038834 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b83ac8d2-cece-4bf9-bb57-a42025cf26d7 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:41.039291 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b83ac8d2-cece-4bf9-bb57-a42025cf26d7 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:41.040081 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b83ac8d2-cece-4bf9-bb57-a42025cf26d7 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:41.040522 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-b83ac8d2-cece-4bf9-bb57-a42025cf26d7 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:41.089053 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-7abae300-bb9c-4028-9cc5-2757e1eb6ae1 req-3aeecd15-f203-44df-bc8c-9ccffa49565a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8a7f76-7980-44f9-8cd7-14bf83678e19", "name": "network-vif-deleted", "tag": "3dd59820-9c6d-4ae2-9614-f101565b22bf"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:06:41.101412 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-7abae300-bb9c-4028-9cc5-2757e1eb6ae1 req-3aeecd15-f203-44df-bc8c-9ccffa49565a service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:41.102010 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-7abae300-bb9c-4028-9cc5-2757e1eb6ae1 req-3aeecd15-f203-44df-bc8c-9ccffa49565a service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:41.113255 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-7abae300-bb9c-4028-9cc5-2757e1eb6ae1 req-3aeecd15-f203-44df-bc8c-9ccffa49565a service nova] Creating event network-vif-deleted:3dd59820-9c6d-4ae2-9614-f101565b22bf for instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 on hv-cinder-83699 May 23 11:06:41.119096 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-7abae300-bb9c-4028-9cc5-2757e1eb6ae1 req-3aeecd15-f203-44df-bc8c-9ccffa49565a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033830 May 23 11:06:41.119790 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 517/1020] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 11:06:41.165709 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-b83ac8d2-cece-4bf9-bb57-a42025cf26d7 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:06:41.173100 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-b83ac8d2-cece-4bf9-bb57-a42025cf26d7 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 200 len: 1393 microversion: 2.1 time: 0.149856 May 23 11:06:41.173675 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 504/1021] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:06:41 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:06:42.191867 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5d8e75fd-769c-41ca-b008-e3a0a86eb485 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:42.192563 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-5d8e75fd-769c-41ca-b008-e3a0a86eb485 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: dc8a7f76-7980-44f9-8cd7-14bf83678e19] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:42.199334 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d8e75fd-769c-41ca-b008-e3a0a86eb485 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:42.199822 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d8e75fd-769c-41ca-b008-e3a0a86eb485 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:42.200590 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d8e75fd-769c-41ca-b008-e3a0a86eb485 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:42.201029 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-5d8e75fd-769c-41ca-b008-e3a0a86eb485 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:42.214548 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-5d8e75fd-769c-41ca-b008-e3a0a86eb485 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] HTTP exception thrown: Instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 could not be found. May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5d8e75fd-769c-41ca-b008-e3a0a86eb485 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Request method failure captured: May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 HTTP/1.1 May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2kd9hEhh57Ok7jJSd7dcWGrkG5MpuYoNBJVjug8jjqcnsUUHQT2f7kNdX2T95nGyw6W4bde8DtZRaPob4oVV0_vWpOfdYESpRGRtJyB1B4jkw8wNmiloOTTpOtsJYgdW55tZte2eIBbKfHZdYqNMef3QIByVfFxDq1Bihnzx2_Q_XI May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 86e332b470c841db8d7d852c1c0a4a26 May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 11:06:42.216143 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e332b470c841db8d7d852c1c0a4a26", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 86e332b470c841db8d7d852c1c0a4a26 May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-TestVolumeBootPattern-1896703949-project May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 5b53f05946e34f9f8395526212c5b17f May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-TestVolumeBootPattern-1896703949-project May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 could not be found. May 23 11:06:42.217795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': 'dc8a7f76-7980-44f9-8cd7-14bf83678e19'} May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 could not be found. May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 11:06:42.218681 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 could not be found. May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 could not be found. May 23 11:06:42.220009 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:06:42.221179 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-5d8e75fd-769c-41ca-b008-e3a0a86eb485 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Returning 404 to user: Instance dc8a7f76-7980-44f9-8cd7-14bf83678e19 could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 11:06:42.221179 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-5d8e75fd-769c-41ca-b008-e3a0a86eb485 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19" status: 404 len: 111 microversion: 2.1 time: 0.030287 May 23 11:06:42.221179 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 518/1022] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:06:42 2022] GET /compute/v2.1/servers/dc8a7f76-7980-44f9-8cd7-14bf83678e19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 11:06:45.243247 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-dbb8f7ea-7486-43c0-a610-d1a526517240 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:45.243765 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-dbb8f7ea-7486-43c0-a610-d1a526517240 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:45.245567 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [req-43ef7452-8722-4a93-acc1-4ff92220019f req-fedb3424-071e-4ce9-b424-b92aa8793444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99d04eb-deeb-4c4b-9180-d2b156951af3", "tag": "b512d93e-0bdc-454d-9cf4-6782b1419a9e"}]} {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:06:45.250311 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dbb8f7ea-7486-43c0-a610-d1a526517240 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:45.250761 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dbb8f7ea-7486-43c0-a610-d1a526517240 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:45.251524 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dbb8f7ea-7486-43c0-a610-d1a526517240 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:45.251956 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-dbb8f7ea-7486-43c0-a610-d1a526517240 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:45.253720 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-43ef7452-8722-4a93-acc1-4ff92220019f req-fedb3424-071e-4ce9-b424-b92aa8793444 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:45.254198 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [req-43ef7452-8722-4a93-acc1-4ff92220019f req-fedb3424-071e-4ce9-b424-b92aa8793444 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:45.265496 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.compute.server_external_events [req-43ef7452-8722-4a93-acc1-4ff92220019f req-fedb3424-071e-4ce9-b424-b92aa8793444 service nova] Creating event network-changed:b512d93e-0bdc-454d-9cf4-6782b1419a9e for instance b99d04eb-deeb-4c4b-9180-d2b156951af3 on hv-cinder-83699 May 23 11:06:45.270942 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [req-43ef7452-8722-4a93-acc1-4ff92220019f req-fedb3424-071e-4ce9-b424-b92aa8793444 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031198 May 23 11:06:45.271795 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 519/1023] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 11:06:45.279430 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-dbb8f7ea-7486-43c0-a610-d1a526517240 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Going to try to terminate instance {{(pid=129030) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 11:06:45.362017 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-dbb8f7ea-7486-43c0-a610-d1a526517240 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 204 len: 0 microversion: 2.1 time: 0.123785 May 23 11:06:45.366088 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 505/1024] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 11:06:45 2022] DELETE /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 11:06:45.374160 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-2e1a93e0-894d-4311-be88-06c96409f21f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:45.374859 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-2e1a93e0-894d-4311-be88-06c96409f21f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:45.382380 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2e1a93e0-894d-4311-be88-06c96409f21f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:45.382837 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2e1a93e0-894d-4311-be88-06c96409f21f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:45.383625 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2e1a93e0-894d-4311-be88-06c96409f21f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:45.384050 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-2e1a93e0-894d-4311-be88-06c96409f21f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:45.520095 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-2e1a93e0-894d-4311-be88-06c96409f21f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:06:45.528730 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-2e1a93e0-894d-4311-be88-06c96409f21f tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1576 microversion: 2.1 time: 0.160135 May 23 11:06:45.529313 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 520/1025] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:06:45 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:06:46.546644 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-4f41369f-984e-4db0-aa98-c3c1a4eaf586 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:46.547339 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-4f41369f-984e-4db0-aa98-c3c1a4eaf586 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:46.553737 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4f41369f-984e-4db0-aa98-c3c1a4eaf586 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:46.554834 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4f41369f-984e-4db0-aa98-c3c1a4eaf586 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:46.555589 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4f41369f-984e-4db0-aa98-c3c1a4eaf586 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:46.556021 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-4f41369f-984e-4db0-aa98-c3c1a4eaf586 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:46.728015 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.policy [None req-4f41369f-984e-4db0-aa98-c3c1a4eaf586 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129030) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:06:46.735424 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-4f41369f-984e-4db0-aa98-c3c1a4eaf586 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1576 microversion: 2.1 time: 0.193079 May 23 11:06:46.735996 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 506/1026] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:06:46 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:06:47.752974 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-bfdef02a-4995-4a83-957e-b05fa1d6ab27 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:47.753615 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-bfdef02a-4995-4a83-957e-b05fa1d6ab27 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:47.761612 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfdef02a-4995-4a83-957e-b05fa1d6ab27 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:47.762087 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfdef02a-4995-4a83-957e-b05fa1d6ab27 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:47.762866 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfdef02a-4995-4a83-957e-b05fa1d6ab27 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:47.763303 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-bfdef02a-4995-4a83-957e-b05fa1d6ab27 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:47.791282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [req-e081ba3a-4457-4f47-a797-32d1ed22df84 req-7e1746ef-9b4f-4ec1-aed0-45220efd2ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99d04eb-deeb-4c4b-9180-d2b156951af3", "name": "network-vif-deleted", "tag": "b512d93e-0bdc-454d-9cf4-6782b1419a9e"}]} {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 11:06:47.802191 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-e081ba3a-4457-4f47-a797-32d1ed22df84 req-7e1746ef-9b4f-4ec1-aed0-45220efd2ed9 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:47.803061 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [req-e081ba3a-4457-4f47-a797-32d1ed22df84 req-7e1746ef-9b4f-4ec1-aed0-45220efd2ed9 service nova] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:47.816335 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.compute.server_external_events [req-e081ba3a-4457-4f47-a797-32d1ed22df84 req-7e1746ef-9b4f-4ec1-aed0-45220efd2ed9 service nova] Creating event network-vif-deleted:b512d93e-0bdc-454d-9cf4-6782b1419a9e for instance b99d04eb-deeb-4c4b-9180-d2b156951af3 on hv-cinder-83699 May 23 11:06:47.822476 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [req-e081ba3a-4457-4f47-a797-32d1ed22df84 req-7e1746ef-9b4f-4ec1-aed0-45220efd2ed9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034374 May 23 11:06:47.823260 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 507/1027] 10.222.0.36 () {64 vars in 1317 bytes} [Mon May 23 11:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 11:06:47.834181 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.policy [None req-bfdef02a-4995-4a83-957e-b05fa1d6ab27 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b53f05946e34f9f8395526212c5b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e332b470c841db8d7d852c1c0a4a26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129029) authorize /opt/stack/nova/nova/policy.py:199}} May 23 11:06:47.841878 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-bfdef02a-4995-4a83-957e-b05fa1d6ab27 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 200 len: 1392 microversion: 2.1 time: 0.092877 May 23 11:06:47.842482 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 521/1028] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:06:47 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 1392 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 11:06:48.859224 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-87e24742-bbd1-4bb0-8e43-07a61e380626 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:48.859870 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-87e24742-bbd1-4bb0-8e43-07a61e380626 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: b99d04eb-deeb-4c4b-9180-d2b156951af3] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:48.866677 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-87e24742-bbd1-4bb0-8e43-07a61e380626 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:48.867122 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-87e24742-bbd1-4bb0-8e43-07a61e380626 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:48.867877 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-87e24742-bbd1-4bb0-8e43-07a61e380626 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:48.868309 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-87e24742-bbd1-4bb0-8e43-07a61e380626 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:48.884366 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-87e24742-bbd1-4bb0-8e43-07a61e380626 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] HTTP exception thrown: Instance b99d04eb-deeb-4c4b-9180-d2b156951af3 could not be found. May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-87e24742-bbd1-4bb0-8e43-07a61e380626 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Request method failure captured: May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 HTTP/1.1 May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2kd9hEhh57Ok7jJSd7dcWGrkG5MpuYoNBJVjug8jjqcnsUUHQT2f7kNdX2T95nGyw6W4bde8DtZRaPob4oVV0_vWpOfdYESpRGRtJyB1B4jkw8wNmiloOTTpOtsJYgdW55tZte2eIBbKfHZdYqNMef3QIByVfFxDq1Bihnzx2_Q_XI May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 86e332b470c841db8d7d852c1c0a4a26 May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 11:06:48.885980 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e332b470c841db8d7d852c1c0a4a26", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 86e332b470c841db8d7d852c1c0a4a26 May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-TestVolumeBootPattern-1896703949-project May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 5b53f05946e34f9f8395526212c5b17f May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-TestVolumeBootPattern-1896703949-project May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance b99d04eb-deeb-4c4b-9180-d2b156951af3 could not be found. May 23 11:06:48.887619 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': 'b99d04eb-deeb-4c4b-9180-d2b156951af3'} May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99d04eb-deeb-4c4b-9180-d2b156951af3 could not be found. May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 11:06:48.888710 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99d04eb-deeb-4c4b-9180-d2b156951af3 could not be found. May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99d04eb-deeb-4c4b-9180-d2b156951af3 could not be found. May 23 11:06:48.890282 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:06:48.891749 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-87e24742-bbd1-4bb0-8e43-07a61e380626 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Returning 404 to user: Instance b99d04eb-deeb-4c4b-9180-d2b156951af3 could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 11:06:48.891749 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-87e24742-bbd1-4bb0-8e43-07a61e380626 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3" status: 404 len: 111 microversion: 2.1 time: 0.032468 May 23 11:06:48.891749 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 508/1029] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:06:48 2022] GET /compute/v2.1/servers/b99d04eb-deeb-4c4b-9180-d2b156951af3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 11:06:49.317622 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-77425c1e-4f3b-4fdb-9e88-e3c43b2da969 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:49.318157 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.compute.api [None req-77425c1e-4f3b-4fdb-9e88-e3c43b2da969 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129029) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:49.325337 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77425c1e-4f3b-4fdb-9e88-e3c43b2da969 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:49.325787 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77425c1e-4f3b-4fdb-9e88-e3c43b2da969 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:49.326585 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77425c1e-4f3b-4fdb-9e88-e3c43b2da969 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:49.327022 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG oslo_concurrency.lockutils [None req-77425c1e-4f3b-4fdb-9e88-e3c43b2da969 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:49.339873 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.wsgi [None req-77425c1e-4f3b-4fdb-9e88-e3c43b2da969 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] HTTP exception thrown: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-77425c1e-4f3b-4fdb-9e88-e3c43b2da969 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Request method failure captured: May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: request: DELETE /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e HTTP/1.1 May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept: application/json May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Accept-Encoding: identity May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Connection: close May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Length: 0 May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Content-Type: application/json May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Host: 10.222.0.36 May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Openstack-System-Scope: None May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: User-Agent: python-urllib3/1.26.9 May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Auth-Token: gAAAAABii2kd9hEhh57Ok7jJSd7dcWGrkG5MpuYoNBJVjug8jjqcnsUUHQT2f7kNdX2T95nGyw6W4bde8DtZRaPob4oVV0_vWpOfdYESpRGRtJyB1B4jkw8wNmiloOTTpOtsJYgdW55tZte2eIBbKfHZdYqNMef3QIByVfFxDq1Bihnzx2_Q_XI May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Id: None May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Domain-Name: None May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Identity-Status: Confirmed May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Is-Admin-Project: True May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Id: default May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Domain-Name: Default May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Id: 86e332b470c841db8d7d852c1c0a4a26 May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Project-Name: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Role: reader,member May 23 11:06:49.341502 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Roles: reader,member May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e332b470c841db8d7d852c1c0a4a26", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Id: 86e332b470c841db8d7d852c1c0a4a26 May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-Tenant-Name: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User: tempest-TestVolumeBootPattern-1896703949-project May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Id: default May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Domain-Name: Default May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Id: 5b53f05946e34f9f8395526212c5b17f May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: X-User-Name: tempest-TestVolumeBootPattern-1896703949-project May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: method: > May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: exception: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:06:49.343131 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: action_args: {'id': '5249a457-7b0f-4659-8591-228ab1ea821e'} May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 11:06:49.344067 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:06:49.345358 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: ERROR nova.api.openstack.wsgi May 23 11:06:49.346939 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-77425c1e-4f3b-4fdb-9e88-e3c43b2da969 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Returning 404 to user: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. {{(pid=129029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 11:06:49.346939 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-77425c1e-4f3b-4fdb-9e88-e3c43b2da969 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 404 len: 111 microversion: 2.1 time: 0.029234 May 23 11:06:49.346939 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 522/1030] 10.222.0.36 () {58 vars in 1238 bytes} [Mon May 23 11:06:49 2022] DELETE /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 11:06:49.356972 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-08e689dc-b5f7-4897-965f-3ebc1e31a8a0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '>' {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:49.357588 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.compute.api [None req-08e689dc-b5f7-4897-965f-3ebc1e31a8a0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] [instance: 5249a457-7b0f-4659-8591-228ab1ea821e] Fetching instance by UUID {{(pid=129030) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 11:06:49.363527 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-08e689dc-b5f7-4897-965f-3ebc1e31a8a0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:49.363994 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-08e689dc-b5f7-4897-965f-3ebc1e31a8a0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:49.364734 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-08e689dc-b5f7-4897-965f-3ebc1e31a8a0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 11:06:49.365168 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG oslo_concurrency.lockutils [None req-08e689dc-b5f7-4897-965f-3ebc1e31a8a0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Lock "0a0b5a72-be8f-4ccc-a37a-e387d6681f68" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 11:06:49.378865 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.wsgi [None req-08e689dc-b5f7-4897-965f-3ebc1e31a8a0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] HTTP exception thrown: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-08e689dc-b5f7-4897-965f-3ebc1e31a8a0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Request method failure captured: May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: request: GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e HTTP/1.1 May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept: application/json May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Accept-Encoding: identity May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Connection: close May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Length: 0 May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Content-Type: application/json May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Host: 10.222.0.36 May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Openstack-System-Scope: None May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: User-Agent: python-urllib3/1.26.9 May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Auth-Token: gAAAAABii2kd9hEhh57Ok7jJSd7dcWGrkG5MpuYoNBJVjug8jjqcnsUUHQT2f7kNdX2T95nGyw6W4bde8DtZRaPob4oVV0_vWpOfdYESpRGRtJyB1B4jkw8wNmiloOTTpOtsJYgdW55tZte2eIBbKfHZdYqNMef3QIByVfFxDq1Bihnzx2_Q_XI May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Id: None May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Domain-Name: None May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Identity-Status: Confirmed May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Is-Admin-Project: True May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Id: default May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Domain-Name: Default May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Id: 86e332b470c841db8d7d852c1c0a4a26 May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Project-Name: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Role: reader,member May 23 11:06:49.380343 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Roles: reader,member May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e332b470c841db8d7d852c1c0a4a26", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e332b470c841db8d7d852c1c0a4a26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Id: 86e332b470c841db8d7d852c1c0a4a26 May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-Tenant-Name: tempest-TestVolumeBootPattern-1896703949 May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User: tempest-TestVolumeBootPattern-1896703949-project May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Id: default May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Domain-Name: Default May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Id: 5b53f05946e34f9f8395526212c5b17f May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: X-User-Name: tempest-TestVolumeBootPattern-1896703949-project May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: method: > May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: exception: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:06:49.381913 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: action_args: {'id': '5249a457-7b0f-4659-8591-228ab1ea821e'} May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: {{(pid=129030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 11:06:49.382867 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. May 23 11:06:49.384337 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: ERROR nova.api.openstack.wsgi May 23 11:06:49.386307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: DEBUG nova.api.openstack.wsgi [None req-08e689dc-b5f7-4897-965f-3ebc1e31a8a0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Returning 404 to user: Instance 5249a457-7b0f-4659-8591-228ab1ea821e could not be found. {{(pid=129030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 11:06:49.386307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO nova.api.openstack.requestlog [None req-08e689dc-b5f7-4897-965f-3ebc1e31a8a0 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e" status: 404 len: 111 microversion: 2.1 time: 0.028765 May 23 11:06:49.386307 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: [pid: 129030|app: 0|req: 509/1031] 10.222.0.36 () {58 vars in 1235 bytes} [Mon May 23 11:06:49 2022] GET /compute/v2.1/servers/5249a457-7b0f-4659-8591-228ab1ea821e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 11:06:50.667813 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: DEBUG nova.api.openstack.wsgi [None req-06ad85a4-343b-4c71-970c-63c58fb434d1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] Calling method '.version_select at 0x7fe72050d3a0>' {{(pid=129029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 11:06:50.687230 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO nova.api.openstack.requestlog [None req-06ad85a4-343b-4c71-970c-63c58fb434d1 tempest-TestVolumeBootPattern-1896703949 tempest-TestVolumeBootPattern-1896703949-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1840680101" status: 202 len: 0 microversion: 2.1 time: 0.023186 May 23 11:06:50.687978 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: [pid: 129029|app: 0|req: 523/1032] 10.222.0.36 () {58 vars in 1262 bytes} [Mon May 23 11:06:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1840680101 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 11:06:52.221855 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:06:52.222834 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Mon May 23 11:06:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 11:08:40.004310 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:08:40.004869 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Mon May 23 11:08:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 11:10:00.996437 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:10:00.997074 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Mon May 23 11:10:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 11:10:07.218939 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:10:07.219521 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Mon May 23 11:10:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 11:10:12.232376 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:10:12.232962 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Mon May 23 11:10:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 11:12:00.013463 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:12:00.014089 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Mon May 23 11:12:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 11:12:03.800516 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:12:03.800516 dv-cinder-836996-25-iscsi devstack@n-api.service[129030]: Mon May 23 11:12:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 11:12:12.732963 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 11:12:12.733527 dv-cinder-836996-25-iscsi devstack@n-api.service[129029]: Mon May 23 11:12:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!